Commit Graph

4288 Commits

Author SHA1 Message Date
Steven Zou
49bb9bfceb Add logger sweeper to periodically clear outdated log files created by the jobs 2018-03-22 23:44:08 +08:00
Daniel Jiang
f7fe8380bd
Merge pull request #4464 from reasonerjt/scan-job-migrate
Integrate new jobservice into docker-compose template
2018-03-22 20:06:46 +08:00
Tan Jiang
7238efd9ae Integrate new jobservice into docker-compose template
This commit doesn't integrate redis.  No change to makefile b/c it
should work once the temporary jobservice_v2 folder is renamed to jobservice.
2018-03-22 19:48:22 +08:00
Steven Zou
579b70c5e4 Inject logger into the execution context of running job for logging
define logger interface
implement a logger base on common log package
add getting log API
inject logger to the job execution context
2018-03-22 18:29:39 +08:00
Steven Zou
b001180d26 Merge branch 'job_service' of https://github.com/vmware/harbor into job_service 2018-03-22 13:43:12 +08:00
Steven Zou
e5f8beb35f Support status hook mechanism to report job status changes
refactor scheduler to extarct separate sub/pub system
fix bug in getJob
return all the stats data of running pools in the health check API
2018-03-22 13:41:00 +08:00
Daniel Jiang
aab34efa49
Merge pull request #4454 from reasonerjt/scan-job-migrate
Add missed package to fix compilation issue
2018-03-21 17:11:12 +08:00
Tan Jiang
b8ec419c8e Add missed package to fix compilation issue 2018-03-21 16:59:32 +08:00
Daniel Jiang
8a86b67b73
Merge pull request #4450 from reasonerjt/scan-job-migrate
Scan job migrate
2018-03-21 16:43:29 +08:00
Tan Jiang
483496ed93 remove swp file 2018-03-21 16:32:21 +08:00
Tan Jiang
613464bc16 Migrate scan job to job service V1 phase1 2018-03-21 16:25:32 +08:00
Tan Jiang
6303785b1b Merge branch 'job_service' of https://github.com/vmware/harbor into scan-job-migrate 2018-03-21 13:06:40 +08:00
Steven Zou
ac544b3ead Support job related operational actions
support stop job
support cancel running generic job
support retry failed job
support checkin details progress of job
2018-03-20 18:03:04 +08:00
Tan Jiang
00825d3ca4 Merge branch 'job_service' of https://github.com/vmware/harbor into scan-job-migrate 2018-03-20 17:37:27 +08:00
Steven Zou
fbc24d85db Support job operation actions like stop/cancel 2018-03-16 19:38:51 +08:00
Tan Jiang
b1d1e039dc Merge branch 'job_service' of https://github.com/vmware/harbor into scan-job-migrate 2018-03-16 15:30:53 +08:00
Daniel Jiang
cbedf099b5
Merge pull request #4342 from yixingjia/apimonitor
Add monitor API for Harbor components
2018-03-16 14:56:58 +08:00
Manjunath Dharamadas
38d6306f3b Move drone clone step out of pipeline (#4420) 2018-03-16 10:48:38 +08:00
Steven Zou
2f97970484 Support update job status for both generic and periodic job
refactor scheduler
refactor period.enqueuer
add stats manager component
2018-03-15 20:23:42 +08:00
stone
139a0c59ba
Merge pull request #4412 from stonezdj/add_ldap_group_param
Add LDAP Group Search Configure Param
2018-03-15 17:02:28 +08:00
Steven Zou
be75145858 Implement API service of getting job stats 2018-03-15 14:33:57 +08:00
Steven Zou
ea912729ec fix golint issues in code 2018-03-15 12:31:54 +08:00
Steven Zou
4b4e0ddfff Refactor job programming model
refine job context
remove setXXX injection methods in job.Interface
use parameters of Run to pass context and parameters
2018-03-15 12:26:01 +08:00
yixingj
4255ed167a Add monitor API for Harbor components.
1>AdminServer.
2>UI.
2018-03-15 10:39:55 +08:00
Steven Zou
28d02931d2 Support saving job stats to the baclend for the redis workerpool 2018-03-15 09:56:07 +08:00
stonezdj
44fc373c6d Add LDAP Group Search Configure Param 2018-03-15 06:16:47 +08:00
Steven Zou
b61dc39278 Refactor the job execution context interface 2018-03-14 19:17:38 +08:00
Steven Zou
5f5fb5b6ec Refine the context related things
change job context to interface
move job conetxt to the env package
move the concrete job implementation to separate folder
2018-03-14 18:24:53 +08:00
Steven Zou
414c36205c Support API service of checking stats of the worker pool 2018-03-14 16:59:00 +08:00
Steven Zou
6b46844565 Add sweeper to clear the outdated data before the workerpool is starting 2018-03-14 15:52:00 +08:00
Daniel Jiang
0efd8e3c54
Merge pull request #4396 from ywk253100/180309_label_resource
Implement adding/removing labels to/from repositories and images API
2018-03-14 14:15:31 +08:00
Wenkai Yin
bcf81224ad Update according to the comments 2018-03-14 13:42:19 +08:00
Steven Zou
7b8971e930 Implement periodically enqueue job feature
add scheduler based on redis
add job wrapper for redis driver
other necessary modules
2018-03-13 23:58:07 +08:00
Yan
3215d328aa
fix run replication bug in nightly (#4402) 2018-03-13 19:21:35 +08:00
Wenkai Yin
36b9c4e458 Implement adding/removing labels to/from repositories and images API 2018-03-12 19:30:05 +08:00
Daniel Jiang
230bb89d1e
Merge pull request #4395 from reasonerjt/fix-project-length-limit
Extend the length of project name in request validation
2018-03-12 19:20:21 +08:00
Tan Jiang
b81b55b0c1 Extend the length of project name in request validation 2018-03-12 16:07:06 +08:00
yixingjia
ac05806dec Reload the attributes of Harbor db and Clair db when restart Harbor. (#4349) 2018-03-12 15:40:45 +08:00
Manjunath Dharamadas
11254a024d Add ability to skip check membership on CI (#4386) 2018-03-12 14:53:16 +08:00
Jesse Hu
7ec809b31e
Refine harbor helm chart README.md (#4390) 2018-03-12 14:29:50 +08:00
sigsbee
4ccd7e7cdf
Add vulneraibility case and add a testcase doc. (#4378)
Add disable schedule 
vulnerability data not ready 
can as an unprivileged user 
scan image with empty vul 
manual scan all
project level image serverity policy 
scan on push
2018-03-12 14:20:37 +08:00
Jesse Hu
dab5dd9879 Update Harbor helm chart to deploy Harbor 1.4.0 release (#4373)
* Update Harbor helm chart to deploy Harbor 1.4.0 release

* Change version to 0.1.0 and fix a doc error

* Fix auth_mode default value

* Refine doc and fix a typo
2018-03-09 18:47:13 +08:00
Wenkai Yin
03bf000770
Merge pull request #4372 from ywk253100/180302_label
Implement label management API
2018-03-09 13:20:00 +08:00
Wenkai Yin
379f113452 Implement label management API 2018-03-09 12:17:27 +08:00
Wenkai Yin
685140cda8
Merge pull request #4375 from ywk253100/180308_smtp_tls
Do the authentication with CRAM-MD5 when the connection is insecure
2018-03-08 17:42:18 +08:00
pengpengshui
c24e0a5959
Merge pull request #4376 from pengpengshui/reptolib
Modify pagenation in Use, project name exist issue #4350 #4205 #4177
2018-03-08 17:34:10 +08:00
pfh
e017f63103 Modify pagenation in Use, project name exist issue #4350 #4205 #4177 2018-03-08 16:25:24 +08:00
Wenkai Yin
0a8929b85e Do the authentication with CRAM-MD5 when the connection is insecure 2018-03-08 14:21:44 +08:00
Steven Zou
7a3c35d178 Implement the base framework of job service V2
add API server
add redis worker pool
add configuration loader
add bootstrap process
add vendor via dep
2018-03-08 13:16:57 +08:00
pengpengshui
7bf277df6e
Merge pull request #4354 from pengpengshui/reptolib
Modify replication rule from page to dialog #4296
2018-03-07 17:34:13 +08:00