From 2cfbbda2a342dcb821f73ac234d525e1b0e661ad Mon Sep 17 00:00:00 2001 From: Henry Zhang Date: Fri, 8 Apr 2016 17:04:47 +0800 Subject: [PATCH] document update --- Deploy/harbor.cfg | 3 +- README.md | 17 ++--- docs/installation_guide.md | 129 +++++++++++++++++++++++++++---------- 3 files changed, 105 insertions(+), 44 deletions(-) diff --git a/Deploy/harbor.cfg b/Deploy/harbor.cfg index b89a5d03c..90dc66540 100644 --- a/Deploy/harbor.cfg +++ b/Deploy/harbor.cfg @@ -30,6 +30,7 @@ ldap_basedn = uid=%s,ou=people,dc=mydomain,dc=com #The password for the root user of mysql db, change this before any production use. db_password = root123 -#Switch for self-registration feature + +#Turn on or off the self-registration feature self_registration = on ##### diff --git a/README.md b/README.md index cbf84220b..44a872e17 100644 --- a/README.md +++ b/README.md @@ -16,11 +16,11 @@ Project Harbor is an enterprise-class registry server. It extends the open sourc * **Internationalization**: Localized for English and Chinese languages. More languages can be added. * **RESTful API**: RESTful APIs are provided for most administrative operations of Harbor. The integration with other management softwares becomes easy. -### Try it -Harbor is self-contained and can be easily deployed via docker-compose. +### Getting Started +Harbor is self-contained and can be easily deployed via docker-compose. The below is a quick-start guide. Refer to the [Installation and Configuration Guide](docs/installation_guide.md) for detail information. **System requirements:** -Harbor only works with docker 1.8+ and docker-compose 1.6.0+ . +Harbor only works with docker 1.10+ and docker-compose 1.6.0+ . The host must be connected to the Internet. 1. Get the source code: @@ -43,16 +43,17 @@ The host must be connected to the Internet. $ docker-compose up ``` -If everything works fine, you can open a browser to visit the admin portal at http://your_registry_host . The default administrator username and password are admin/Harbor12345 . -After creating a project in the admin portal, you can login and use docker commands to push images. The default port of Harbor registry server is 80: +If everything works fine, you can open a browser to visit the admin portal at http://reg.yourdomain.com . The default administrator username and password are admin/Harbor12345 . + +Create a new project, e.g. myproject, in the admin portal. You can then use docker commands to login and push images. The default port of Harbor registry server is 80: ```sh -$ docker login your_registry_host -$ docker push your_registry_host/myrepo/myapp +$ docker login reg.yourdomain.com +$ docker push reg.yourdomain.com/myproject/myrepo ``` **NOTE:** -To simplify the installation process, a pre-built installation package of Harbor is provided so that you don't need to clone the source code. By using this package, you can even install Harbor onto a host that is not connected to the Internet. For details on how to download and use this installation package, please refer to [Installation Guide](docs/installation_guide.md) . +To simplify the installation process, a pre-built installation package of Harbor is provided so that you don't need to clone the source code. By using this package, you can even install Harbor onto a host that is not connected to the Internet. For details on how to download and use this installation package, please refer to [Installation and Configuration Guide](docs/installation_guide.md) . For information on how to use Harbor, please see [User Guide](docs/user_guide.md) . diff --git a/docs/installation_guide.md b/docs/installation_guide.md index 7c5471a4b..03395eb7a 100644 --- a/docs/installation_guide.md +++ b/docs/installation_guide.md @@ -1,35 +1,31 @@ -# Installation Guide of Harbor -### Download the installation package -Harbor can be installed from the source code by using "docker-compose up" command, which goes through a full build process. Besides, a pre-built installation package of each release can be downloaded from the [release page](https://github.com/vmware/harbor/releases). This guide describes the installation of Harbor by using the pre-built package. -### Prerequisites for target machine +# Installation and Configuration Guide of Harbor +Harbor can be installed by two approaches: + +1. Install from the source code, which goes through a full build process. Internet connection is required. +2. Install via a pre-built installation package, which saves time for building the code. Further, it provides a way to install Harbor to a host that is isolated from the Internet (offline installation). + +This guide describes both approaches and their usage. + +## Prerequisites of the target host Harbor is deployed as several Docker containers. Hence, it can be deployed on any Linux distribution that supports Docker. -Before deploying Harbor, the target machine requires Python, Docker, Docker Compose to be installed. +Before deploying Harbor, the target host requires Python, Docker, Docker Compose to be installed. * Python should be version 2.7 or higher. Some Linux distributions (Gentoo, Arch) may not have a Python interpreter installed by default. On those systems, you need to install Python manually. * The Docker engine should be version 1.10 or higher. For the details to install Docker engine, please refer to: https://docs.docker.com/engine/installation/ * The Docker Compose needs to be version 1.6.0 or higher. For the details to install Docker compose, please refer to: https://docs.docker.com/compose/install/ -### Configuration of Harbor -After downloading the package file **harbor-<version>.tgz** from the release page, you need to extract files from the package. Before installing Harbor, you should configure the parameters in the file **harbor.cfg**. You then execute the **prepare** script to generate configuration files for Harbor's containers. Finally, you use Docker Compose to start Harbor. -At minimum, you only need to change the **hostname** attribute in **harbor.cfg** by updating the IP address or the fully qualified domain name (FQDN) of your target machine, for example 192.168.1.10. Please see the next section for the description of each parameter. -``` -$ tar -xzvf harbor-0.1.0.tgz -$ cd harbor -$ vi ./harbor.cfg -...... -$ ./prepare -Generated configuration file: ./config/ui/env -Generated configuration file: ./config/ui/app.conf -Generated configuration file: ./config/registry/config.yml -Generated configuration file: ./config/db/env -The configuration files are ready, please use docker-compose to start the service. -$ sudo docker-compose up -d -...... -``` -After that, you can open a browser and access Harbor via the IP you set in harbor.cfg, such as http://192.168.1.10 . The same IP address is used as the Registry address in your Docker client, for example: -```docker pull 192.168.1.10/library/ubuntu``` +## Install Harbor from the source code -#### Parameters in harbor.cfg -**hostname**: The endpoint for a user to access the user interface and the registry service, for example 192.168.1.10 or exampledomian.com. +To install from the source, the target host must be connected to the Internet. +#### Get the source code: + ```sh + $ git clone https://github.com/vmware/harbor + ``` +#### Configure Harbor +Before installing Harbor, you should configure the parameters in the file **harbor.cfg**. You then execute the **prepare** script to generate configuration files for Harbor's containers. Finally, you use Docker Compose to start Harbor. + +At minimum, you need to change the **hostname** attribute in **harbor.cfg**. The description of each attribute is as follows: + +**hostname**: The hostname for a user to access the user interface and the registry service. It should be the IP address or the fully qualified domain name (FQDN) of your target machine, for example 192.168.1.10 or reg.yourdomain.com . Do NOT use localhost or 127.0.0.1 for the hostname because the registry service needs to be accessed by external clients. **ui_url_protocol**: The protocol for accessing the user interface and the token/notification service, by default it is http. **Email settings**: the following 5 attributes are used to send an email to reset a user's password, they are not mandatory unless the password reset function is needed in Harbor. * email_server = smtp.mydomain.com @@ -42,13 +38,67 @@ After that, you can open a browser and access Harbor via the IP you set in harbo **auth_mode**: The authentication mode of Harbor. By default it is *db_auth*, i.e. the credentials are stored in a database. Please set it to *ldap_auth* if you want to verify user's credentials against an LDAP server. **ldap_url**: The URL for LDAP endpoint, for example ldaps://ldap.mydomain.com. It is only used when **auth_mode** is set to *ldap_auth*. **ldap_basedn**: The basedn template for verifying the user's credentials against LDAP, for example uid=%s,ou=people,dc=mydomain,dc=com. It is only used when **auth_mode** is set to *ldap_auth*. -**db_password**: The password of root user of mySQL database. +**db_password**: The password of root user of mySQL database. +**self_registration**: The flag to turn on or off the user self-registration function. If this flag is turned off, only an admin user can create new users in Harbor. The default value is on. + +#### Build and start Harbor +After configuring harbor.cfg, build and start Harbor by the following commands. Because it requires downloading necesary files from the Internet, it may take a while for the docker-compose process to finish. + + ```sh + $ cd Deploy + + $ ./prepare + Generated configuration file: ./config/ui/env + Generated configuration file: ./config/ui/app.conf + Generated configuration file: ./config/registry/config.yml + Generated configuration file: ./config/db/env + The configuration files are ready, please use docker-compose to start the service. + + $ sudo docker-compose up -d + ``` + +If everything works fine, you can open a browser to visit the admin portal at http://reg.yourdomain.com . The default administrator username and password are admin/Harbor12345 . + +Create a new project, e.g. myproject, in the admin portal. You can then use docker commands to login and push images. The default port of Harbor registry server is 80: +```sh +$ docker login reg.yourdomain.com +$ docker push reg.yourdomain.com/myproject/myrepo +``` +**NOTE:** The default installation of Harbor uses HTTP protocol, you should add the option "--insecure-registry" to your client's Docker daemon and restart Docker service. + +For information on how to use Harbor, please refer to [User Guide of Harbor](user_guide.md) . + +#### Configure Harbor with HTTPS Access +Because Harbor does not ship with any certificates, it uses HTTP by default to serve registry requests. This makes it relatively simple to configure, especially for a development or testing environment. However, it is highly recommended that security be enabled for any production environment. Refer to [Configure Harbor with HTTPS Access](configure_https.md) if you want to enable HTTPS access to Harbor. + +## Install Harbor via a pre-built installation package + +A pre-built installation package of each release can be downloaded from the [release page](https://github.com/vmware/harbor/releases). After downloading the package file **harbor-<version>.tgz** , extract files in the package. +``` +$ tar -xzvf harbor-0.1.1.tgz +$ cd harbor +``` + +Then configure Harbor by following instructions in Section [Configure Harbor](#markdown-header-configure-harbor). Next, run **prepare** script to generate config files and use docker compose to build Harbor's container images and eventually spin it up. + + +``` +$ ./prepare +Generated configuration file: ./config/ui/env +Generated configuration file: ./config/ui/app.conf +Generated configuration file: ./config/registry/config.yml +Generated configuration file: ./config/db/env +The configuration files are ready, please use docker-compose to start the service. + +$ sudo docker-compose up -d +...... +``` ### Deploy Harbor to a target machine that does not have Internet access When you run *docker-compose up* to start Harbor, it will pull base images from Docker Hub and build new images for the containers. This process requires accessing the Internet. If you want to deploy Harbor to a host that is not connected to the Internet, you need to prepare Harbor on a machine that has access to the Internet. After that, you export the images as tgz files and transfer them to the target machine, then load the tgz file into Docker's local image repo. #### Build and save images for offline installation -On a machine that is connected to the Internet, extract files from the installation package. Then run command "docker-compose build" to build the images and use the script *save_image.sh* to export them as tar files. The tar files will be stored in **images** directory. Next, package everything in the directory **harbor** into a tgz file and transfer it to the target machine. This can be done by executing the following commands: +On a machine that is connected to the Internet, extract files from the pre-built installation package. Then run command "docker-compose build" to build the images and use the script *save_image.sh* to export them as tar files. The tar files will be stored in **images** directory. Next, package everything in the directory **harbor** into a tgz file and transfer it to the target machine. This can be done by executing the following commands: ``` $ cd harbor @@ -66,14 +116,15 @@ finished saving the image of nginx saving the image of registry finished saving the image of registry $ cd ../ -$ tar -cvzf harbor_offline-0.1.0.tgz harbor +$ tar -cvzf harbor_offline-0.1.1.tgz harbor ``` -The package file **harbor_offline-0.1.0.tgz** contains the images saved by previously steps and the files required to start Harbor. -You can use tools such as scp to transfer the file **harbor_offline-0.1.0.tgz** to the target machine that does not have Internet connection. On the target machine, you can execute the following commands to start Harbor. Again, before running the **prepare** script, be sure to update **harbor.cfg** to reflect the right configuration of the target machine. +The file **harbor_offline-0.1.0.tgz** contains the images saved by previously steps and the files required to start Harbor. +You can use tools such as scp to transfer the file **harbor_offline-0.1.0.tgz** to the target machine that does not have Internet connection. On the target machine, you can execute the following commands to start Harbor. Again, before running the **prepare** script, be sure to update **harbor.cfg** to reflect the right configuration of the target machine. (Refer to Section [Configure Harbor](#markdown-header-configure-harbor) .) ``` -$ tar -xzvf harbor_offline-0.1.tgz +$ tar -xzvf harbor_offline-0.1.1.tgz $ cd harbor + # load images save by excute ./save_image.sh $ ./load_image.sh loading the image of harbor_ui @@ -84,12 +135,14 @@ loading the image of nginx finished loading the image of nginx loading the image of registry finished loading the image of registry + # Make update to the parameters in ./harbor.cfg $ ./prepare Generated configuration file: ./config/ui/env Generated configuration file: ./config/ui/app.conf Generated configuration file: ./config/registry/config.yml Generated configuration file: ./config/db/env + The configuration files are ready, please use docker-compose to start the service. # Build the images and then start the services $ sudo docker-compose up -d @@ -125,7 +178,7 @@ Starting harbor_registry_1 Starting harbor_ui_1 Starting harbor_proxy_1 ```` -Remove Harbor's containers (the image data and Harbor's database files remains on the file system): +Remove Harbor's containers while keeping the image data and Harbor's database files on the file system: ``` $ sudo docker-compose rm Going to remove harbor_proxy_1, harbor_ui_1, harbor_registry_1, harbor_mysql_1, harbor_log_1 @@ -135,8 +188,14 @@ Removing harbor_ui_1 ... done Removing harbor_registry_1 ... done Removing harbor_mysql_1 ... done ``` + +Remove Harbor's database and image data (for a clean reinstallation): +```sh +$ rm -r /data/database +$ rm -r /data/registry +``` + [Docker Compose command-line reference](https://docs.docker.com/compose/reference/) describes the usage information for the docker-compose subcommands. ### Persistent data and log files -By default, the data of database and image files in the registry are persisted in the directory **/data/** of the target machine. When Harbor's containers are removed and recreated, the data remain unchanged. -Harbor leverages rsyslog to collect the logs of each container, by default the log files are stored in the directory **/var/log/harbor/** on Harbor's host. \ No newline at end of file +By default, the data of database and image files in the registry are persisted in the directory **/data/** of the target machine. When Harbor's containers are removed and recreated, the data remain unchanged. Harbor leverages rsyslog to collect the logs of each container, by default the log files are stored in the directory **/var/log/harbor/** on Harbor's host.