Commit Graph

5152 Commits

Author SHA1 Message Date
Steven Zou
9f0f959749 Fix the multipart form data content missing issue by refill the content again before passing to the backend server
refill the multipart form data at harbor API layer
export write error functions from the chartserver package
refactor the error format to be compatiable with push plugin
2018-07-24 10:32:20 +08:00
Wenkai Yin
f22121dd03 Add support for external Redis configuration in helm chart
This commit adds "external" part in redis configuration in helm chart, by this way users can use the existing external Redis rather than using the internal one
2018-07-23 17:42:23 +08:00
Steven Zou
405e89158a
Merge pull request #5364 from steven-zou/fix_file_missing_issue
Fix the issue of returning '* file not found' error
2018-07-23 15:32:02 +08:00
Daniel Jiang
04cd861a18
Merge pull request #5362 from reasonerjt/clean-up-vendor
Clean up vendor folder
2018-07-23 15:28:40 +08:00
Steven Zou
2f0b706f84 Fix the issue of returning '* file not found' error
return default empty when file is not existing
2018-07-23 14:53:40 +08:00
Steven Zou
8436d2b4e6
Merge pull request #5363 from vmware/midofy_max_works_num
Modify the cfg option 'max_job_workers' from 50 to 10 to reduce the resource requirement
2018-07-23 14:40:35 +08:00
Daniel Jiang
b9762afbdd Clean up vendor folder
Add `prune` section to Gopkg.toml to remove the unused packages from
vendor folder.
Update the reference of `semver` and `distribution` repo.
2018-07-23 14:40:25 +08:00
Steven Zou
32f0ceade3 Modify the cfg option 'max_job_workers' from 50 to 10 to reduce the resource requirement 2018-07-23 13:36:46 +08:00
Steven Zou
bb380e6dbc
Merge pull request #5314 from steven-zou/chart_repo_supporting
Refactor chart API endpoints
2018-07-20 20:43:55 +08:00
Steven Zou
0227a1315a Keep the chart server related configurations in adminserver
append chart server related config options to the supporting list of adminserver
provide chart server related config access method in the API layer
update prepare script and ui env template file to enable cache driver config for chart server API
append flag info in the systeminfo API to indicate if chart server is deployed with Harbor
refactor the response rewriting logic to return structual error object
add api init method to initilizing objects required in API handlers
chage owner of the storage folder
update offline/online package scripts in Harbor-Util.robot
2018-07-20 19:40:33 +08:00
Yan
efdb57548f
add admin job api (#5344)
It supports Harbor admin to trigger job either manual or
schedule. The job will be populated to job service to execute. 
The api includes:
1. POST /api/system/gc
2, GET /api/system/gc/:id 
3, GET /api/system/gc/:id/log
4, PUT/GET/POST /api/system/gc/schedule
2018-07-20 19:22:37 +08:00
Wenkai Yin
bbb190327d
Merge pull request #5319 from BowlingX/master
Remove lost+found folder in database volume on initial start
2018-07-20 16:39:57 +08:00
Daniel Jiang
6c664ee993 Update photon base images (#5346)
This commit update the base photon image from vmware/photon:1.0 to
photon:1.0, per suggestion by photon team.
2018-07-19 20:45:20 +08:00
Daniel Jiang
b764eed123
Merge pull request #5345 from wy65701436/master-basea
Update e2e cases
2018-07-19 19:30:22 +08:00
Steven Zou
726d81803b Fix conflicts in Makefiles and prepare script files with upstream 2018-07-19 03:17:05 -07:00
Yan
85ded71816 Update e2e cases
refactor e2e test cases to support new CI pipeline
fix issues caused by recently UI change
2018-07-19 02:22:03 -07:00
Daniel Jiang
392d95bf7b
Merge pull request #5321 from stonezdj/from_1.5.2
Add SafeCast function and set default value for some system configure  -- target master
2018-07-19 17:16:08 +08:00
Steven Zou
22ea7dd91f Update the related build scripts to package the chart repo server
add env file template for chart repo server in make/common/config/chartserver
update the Makefiles to support build chart repo server
add docker file and related build scripts for upstream chart server - chartmuseum
update prepare to support generating chart server related configs
add docker compose file for the chart server
add build/install command options to install with/without chart repo server
update install.sh to support chart repo server installation
2018-07-19 16:47:05 +08:00
Daniel Jiang
6b92a538b4 Update Makefile and OSL (#5337)
This commit adds the OSL to repo, and updates Makefile to package it.
2018-07-19 15:47:37 +08:00
Daniel Jiang
638f3a0ae2
Merge pull request #5336 from ywk253100/180718_chart_bug_fix
Fix the mismatch of property used in helm chart
2018-07-19 15:09:42 +08:00
Wenkai Yin
affc63f4d1 Fix the mismatch of property used in helm chart
This commit fixes the issue mentioned int #5326
2018-07-18 17:56:52 +08:00
Wenkai Yin
af9c99cf2f Support the configuration of registry storage in helm chart
This commit adds the registry storage configuration to the values.yaml. By this way, users can cusomize the storage they use.
2018-07-18 17:52:22 +08:00
Wenkai Yin
993d51274f
Merge pull request #5325 from reasonerjt/update-readme-msgtemplate
Update README and .gitmessage
2018-07-18 09:52:38 +08:00
stonezdj
f5e82f75a7 Add SafeCast function and set default value for some sytem configure
Add SafeCastString, SafeCastInt, SafeCastFloat64, SafeCastBool function to check
the type matched and avoid panic in runtime

Add default value to configure settings to avoid cannot save configure
issue
2018-07-17 17:00:06 +08:00
Daniel Jiang
ade4e62d2b Update README and .gitmessage
1) Remove the reference of MYSQL from README.md
2) Update commit message template to inert an empty line between title
and body.
2018-07-17 16:42:03 +08:00
Daniel Jiang
2d656c01b7
Merge pull request #5318 from ywk253100/180716_user_guide
Update the user guide
2018-07-17 14:32:25 +08:00
David Heidrich
6fea7f7cb2 Remove lost+found folder in database root on initial start 2018-07-16 16:27:58 +02:00
Yan
9e65499c10
Add garbage collection job implemention, this job could (#5268)
be triggered by manual and schedule. It calls registrtctl
to do the GC job, and log the output.
2018-07-16 18:08:40 +08:00
Wenkai Yin
be25d15fcc Update the user guide
Add repllication label filter to the user guide and replace a few images used in the doc
2018-07-16 18:03:31 +08:00
Yan
d5b85a6748
Add the registry controller httpserver, it's responsible for controlling (#5265)
docker regsitry. This version has the API to call regsitry GC with jobservice
secret. Seprates it into a standalone container as do not want to invoke two
processes in one container.

It needs to mount the registry storage into this container in order to do GC,
and needs to copy the registry binary into it.
2018-07-16 16:50:28 +08:00
Steven Zou
b572e64a68 Refactor chart API endpoints
add /chartrepo after /api
add /chartrepo before /index.yaml,/:repo/index.yaml and /:repo/charts/:filename
add debug messages to the potential debug points
add more supporting mime types "multipart/form-data", "application/octet-stream" to the API endpoints

update travis file to inject ENV for UT cases of chart repo
2018-07-16 14:33:39 +08:00
Wenkai Yin
8a92019e8e
Merge pull request #5310 from reasonerjt/adminserver-update-schema
Let adminserver initialise the DB schema.
2018-07-16 12:52:11 +08:00
James
3655f7bcd3
Merge pull request #5312 from clouderati/master
Tweaking partners.md
2018-07-14 19:31:57 -04:00
James
65ffdbf3af Tweaking partners.md
- Removing blank space at EoL
- Adding China Mobile
2018-07-13 12:55:42 -04:00
Daniel Jiang
c3149bee4e
Merge pull request #5241 from vmware/ninjadq-fix-type-on-migration-doc
Fix images name typo on migration doc
2018-07-13 17:46:09 +08:00
Daniel Jiang
0d6ea995e1 Let adminserver initialise the DB schema.
This commit make update to remove the code from ui container to init the
DB schema.  As UI has dependency on admin server, so it's safe to assume
adminserver has to be ready first.  Regardless the setting of the config
store of admin server, it will try to access and intialize the schema of
database.
2018-07-13 17:32:17 +08:00
Daniel Jiang
8f8a6a1fc9
Merge pull request #5304 from steven-zou/chart_repo_supporting
Add API routes of chart repo services in harbor API router
2018-07-13 16:55:49 +08:00
Steven Zou
3a44f76b94 Add API routes of chart repo services in harbor API router
add chart repo API controller
update GetChartVersion to extract repo name from the request
update the corresponding UI cases

update the chart controller initialization process
2018-07-13 16:10:46 +08:00
Daniel Jiang
bd92b165c8
Merge pull request #5309 from ywk253100/180713_redis
Fix permission deny issue when Redis starting
2018-07-13 15:33:51 +08:00
Wenkai Yin
e0f2a3d5ce Fix permission deny issue when Redis starting
This commit changes the ownership of directory that Redis uses to user redis when starting up
2018-07-13 14:20:20 +08:00
Daniel Jiang
799a6b479a
Merge pull request #5289 from ywk253100/180710_chart
Fix misc issues of Harbor charts
2018-07-13 11:21:24 +08:00
timchenxiaoyu
a912a55ac2 add sync registry env (#5294)
By default Harbor will call catalog API of registry and sync the result to DB, this becomes problematic when registry is configured to custom storage service, there maybe inconsistent result and the whole process may be very time consuming.
So in this commit a env var SYNC_REGISTRY is introduced if user want Harbor to sync the repo when it starts up, by default it's false.
2018-07-13 11:15:41 +08:00
Daniel Jiang
f7a29363ed
Merge pull request #5296 from reasonerjt/clair-bump-up-v2.0.4
Bump up clair to v2.0.4
2018-07-12 15:09:17 +08:00
Daniel Jiang
bc1969156e Bump up clair to v2.0.4
This commit bump up clair to v2.0.4.  The current build process is
download the binary from google storage, the update of the binary in
google storage is not reflected in this commit.
2018-07-12 13:59:51 +08:00
Steven Zou
0dfc273ee8
Merge pull request #5246 from kulong0105/master
make/docker-compose.tpl: fix wrong mount configuration(#5208)
2018-07-12 13:54:35 +08:00
Daniel Jiang
e415d56099
Merge pull request #5258 from steven-zou/chart_repo_supporting
Implement the API services to support chart repo functions
2018-07-11 18:46:36 +08:00
Steven Zou
6ea9291c09 Refactor code after PR reviewing
pass cache config to the constructor of chart cache
use break loop to instead of return in GetIndexYaml
fix typo reids to redis
pass credential to the reverse proxy and chart client via constructors
2018-07-11 17:31:34 +08:00
Wenkai Yin
c72a7db4be Fix misc issues of Harbor charts
1. Fix the pull/push commands showed on UI are incorrect
2. Replace "insecureRegistry" with "externalProtocol"
3. Using the secret rather than pasting text if users want to use the certificate of themselves
4. Refine NOTES.txt
2018-07-11 17:16:42 +08:00
Steven Zou
da4359f56b Add UT cases for the code of supporting chart repo server
add UT cases for cache
add UT cases for ChartOperator
add UT cases for the main API service of chart server
export some consts in the security.go of filter package to let them visible in chartserver package
2018-07-11 13:55:35 +08:00
Daniel Jiang
5357b7ea76
Merge pull request #5273 from wy65701436/conf-reg-redis
Update docker registry cache from inmemory to redis.
2018-07-09 20:03:25 +08:00