Commit Graph

1394 Commits

Author SHA1 Message Date
Deng, Qian
557c68a57c Abstract repo click as a output event 2018-03-29 19:37:23 +08:00
Steven Zou
e454456de2 Merge branch 'job_service' into add_ut_period 2018-03-28 19:54:03 +08:00
Qian Deng
6ca2f39186
Merge pull request #4491 from danielefranceschi/master
fix size suffix label for >1GB images
2018-03-28 18:44:43 +08:00
Steven Zou
d7aa1dacf0 Add UT cases for package period 2018-03-28 17:35:57 +08:00
Daniel Jiang
2c2cbd9c52
Merge pull request #4510 from reasonerjt/master
Add indexes to job tables and bump up schema version.
2018-03-28 16:58:16 +08:00
Steven Zou
75f4f7e0a4
Merge pull request #4513 from vmware/steven_job_service
Add UT cases for package opm (update travis yaml to start redis conta…
2018-03-28 16:30:03 +08:00
Tan Jiang
b6df6cf169 Add indexes to job tables and bump up schema version. 2018-03-28 16:15:54 +08:00
Wenkai Yin
22e06c46e3
Merge pull request #4512 from ywk253100/180328_replication_hook
Handle replication job status hook
2018-03-28 16:10:51 +08:00
Steven Zou
33c3603af2 Add waiting time before triggering http request 2018-03-28 15:57:59 +08:00
Steven Zou
d3909bb633 Add UT cases for package opm (update travis yaml to start redis container)
Fix data race issue in opm package
2018-03-28 15:28:34 +08:00
Wenkai Yin
55035ada2d
Merge pull request #4490 from ywk253100/180326_label
Delete the mapping relationship between resources and labels when the label is deleted
2018-03-28 14:38:01 +08:00
Steven Zou
d183226570
Merge pull request #4507 from vmware/steven_job_service
Fix the issue of causing config test failed
2018-03-28 14:16:09 +08:00
Qian Deng
a12c213cd1
Merge pull request #4494 from pengpengshui/tagdetail
Modify tag detail page and fix label bugs
2018-03-28 14:10:01 +08:00
Steven Zou
ee2da73c71 Refactor the job stats manager (remove useless object references) 2018-03-28 12:51:55 +08:00
Steven Zou
3ce31586df Fix the issue of causing config test failed 2018-03-28 12:40:36 +08:00
Steven Zou
b943bed6e6 Refactor redis pool and job stats manager for clarifying functions
also add UT cases for logger and part of opm package

Fix config test case issue
2018-03-28 12:11:45 +08:00
Daniel Jiang
0918a0ac7e
Merge pull request #4504 from reasonerjt/scan-job-migrate
Integrate with status hook of jobservice
2018-03-28 09:50:49 +08:00
Tan Jiang
0abf53c112 fix golint 2018-03-27 21:30:37 +08:00
Tan Jiang
be97a91650 Integrate with jobservice webhook 2018-03-27 21:27:52 +08:00
wangyan
01487b8221 Add readonly into systeminfo 2018-03-27 04:29:20 -07:00
Steven Zou
02b73b50f2 Merge branch 'job_service' of https://github.com/vmware/harbor into job_service 2018-03-27 18:19:30 +08:00
Steven Zou
660d2610ba Add UT cases for api,core and config package
do changes to enable interfaces
2018-03-27 18:17:46 +08:00
pfh
22fa1ba189 Add control about label for admiral and standalone 2018-03-27 14:31:18 +08:00
pfh
42fa690f90 Modify tag detail page and fix label bugs 2018-03-27 10:12:37 +08:00
Tan Jiang
c859616e25 fix golint and go vet issue 2018-03-26 22:10:01 +08:00
Daniele Franceschi
71eeebec6f
fix rendering suffix for >1GB images 2018-03-26 14:48:13 +02:00
Tan Jiang
582deea9e7 resolve conflict 2018-03-26 18:11:39 +08:00
Tan Jiang
41ce0891ab Trigger scan job from UI. 2018-03-26 18:07:21 +08:00
Wenkai Yin
38568a1d2c
Merge pull request #4485 from ywk253100/180326_period_job
Create a job to call UI's replication API to do the period replication job
2018-03-26 17:31:10 +08:00
Steven Zou
e966698939 Extarct out redis pool initialization code to bootstrap 2018-03-26 16:38:53 +08:00
Tan Jiang
745b21abbc Merge remote-tracking branch 'upstream/master' into scan-job-migrate 2018-03-26 15:39:42 +08:00
Steven Zou
7663592551 Merge branch 'job_service' of https://github.com/vmware/harbor into job_service 2018-03-26 15:30:36 +08:00
Steven Zou
5e2543833b Replace log in commmon package to logger in logger package for loose couple 2018-03-26 15:30:16 +08:00
stone
203b1b52bb
Merge pull request #4415 from stonezdj/user_group_and_project_member
Add DAO for user group and project member
2018-03-26 15:21:20 +08:00
stonezdj
49d960b060 Add DAO for project member and user group 2018-03-26 14:38:32 +08:00
yixingj
cb64ad96ff Make endpoint configurable
Move all the endpoint to harbor.cfg
2018-03-26 10:50:18 +08:00
Tan Jiang
381ecc3521 Merge with master 2018-03-26 10:37:17 +08:00
Wenkai Yin
dd156ca243 Handle replication job status hook 2018-03-24 21:18:58 +08:00
Wenkai Yin
1fea594c3d Trigger replication job from UI with new jobservice 2018-03-24 18:10:50 +08:00
Steven Zou
ba85378ac3 Merge branch 'job_service' of https://github.com/vmware/harbor into job_service 2018-03-24 16:45:46 +08:00
Steven Zou
4cc9e0bf47 Close the open IO stream used by the job logger after job eixting 2018-03-24 16:45:26 +08:00
Wenkai Yin
85f357ec6b Delete the mapping relationship between resources and labels when the label is deleted 2018-03-24 02:22:51 +08:00
Wenkai Yin
e63d5a1c06 Create a job to call UI's replication API to do the period replication job 2018-03-23 23:53:15 +08:00
Wenkai Yin
837f46872a
Merge pull request #4463 from ywk253100/180313_replication_job
Migrate replication job to the new jobservice
2018-03-23 19:04:12 +08:00
Wenkai Yin
ed08a42e4b Migrate replication job to the new jobservice 2018-03-23 18:36:37 +08:00
Yan
cbcca015b0
add read only mode to stop docker push (#4433) 2018-03-23 03:16:08 -07:00
Steven Zou
75e29782f6 Implement job context for harbor jobs
initialize DAO
get configurations from admin server
2018-03-23 17:26:41 +08:00
Steven Zou
e160804be2 Fix nil job returned bug 2018-03-23 13:50:23 +08:00
pfh
71124d08dd Add label module 2018-03-23 09:58:06 +08:00
Steven Zou
49bb9bfceb Add logger sweeper to periodically clear outdated log files created by the jobs 2018-03-22 23:44:08 +08:00
Daniel Jiang
b4a4eb11c6
Merge pull request #4459 from ywk253100/180321_package_upgrade
Upgrade packages used by Harbor
2018-03-22 19:03:10 +08:00
Steven Zou
579b70c5e4 Inject logger into the execution context of running job for logging
define logger interface
implement a logger base on common log package
add getting log API
inject logger to the job execution context
2018-03-22 18:29:39 +08:00
Steven Zou
b001180d26 Merge branch 'job_service' of https://github.com/vmware/harbor into job_service 2018-03-22 13:43:12 +08:00
Steven Zou
e5f8beb35f Support status hook mechanism to report job status changes
refactor scheduler to extarct separate sub/pub system
fix bug in getJob
return all the stats data of running pools in the health check API
2018-03-22 13:41:00 +08:00
Wenkai Yin
c6e65d2ded Fuzzy matching repository name in GET repositories API 2018-03-22 13:38:26 +08:00
Wenkai Yin
0b7d4af4c1 Upgrade packages used by Harbor 2018-03-22 13:10:49 +08:00
Tan Jiang
b8ec419c8e Add missed package to fix compilation issue 2018-03-21 16:59:32 +08:00
Tan Jiang
483496ed93 remove swp file 2018-03-21 16:32:21 +08:00
Tan Jiang
613464bc16 Migrate scan job to job service V1 phase1 2018-03-21 16:25:32 +08:00
Tan Jiang
6303785b1b Merge branch 'job_service' of https://github.com/vmware/harbor into scan-job-migrate 2018-03-21 13:06:40 +08:00
Yan
5edbd00318
Revise harbor build version (#4445) 2018-03-21 13:03:49 +08:00
Wenkai Yin
838b439560 Implement filter repository and tags by label API 2018-03-21 10:51:06 +08:00
Wenkai Yin
a7a72f78bd Return role and repository count info in GET project API 2018-03-20 19:09:06 +08:00
Steven Zou
ac544b3ead Support job related operational actions
support stop job
support cancel running generic job
support retry failed job
support checkin details progress of job
2018-03-20 18:03:04 +08:00
Tan Jiang
00825d3ca4 Merge branch 'job_service' of https://github.com/vmware/harbor into scan-job-migrate 2018-03-20 17:37:27 +08:00
Steven Zou
fbc24d85db Support job operation actions like stop/cancel 2018-03-16 19:38:51 +08:00
Tan Jiang
b1d1e039dc Merge branch 'job_service' of https://github.com/vmware/harbor into scan-job-migrate 2018-03-16 15:30:53 +08:00
Daniel Jiang
cbedf099b5
Merge pull request #4342 from yixingjia/apimonitor
Add monitor API for Harbor components
2018-03-16 14:56:58 +08:00
Steven Zou
2f97970484 Support update job status for both generic and periodic job
refactor scheduler
refactor period.enqueuer
add stats manager component
2018-03-15 20:23:42 +08:00
Steven Zou
be75145858 Implement API service of getting job stats 2018-03-15 14:33:57 +08:00
Steven Zou
ea912729ec fix golint issues in code 2018-03-15 12:31:54 +08:00
Steven Zou
4b4e0ddfff Refactor job programming model
refine job context
remove setXXX injection methods in job.Interface
use parameters of Run to pass context and parameters
2018-03-15 12:26:01 +08:00
yixingj
4255ed167a Add monitor API for Harbor components.
1>AdminServer.
2>UI.
2018-03-15 10:39:55 +08:00
Steven Zou
28d02931d2 Support saving job stats to the baclend for the redis workerpool 2018-03-15 09:56:07 +08:00
stonezdj
44fc373c6d Add LDAP Group Search Configure Param 2018-03-15 06:16:47 +08:00
Steven Zou
b61dc39278 Refactor the job execution context interface 2018-03-14 19:17:38 +08:00
Steven Zou
5f5fb5b6ec Refine the context related things
change job context to interface
move job conetxt to the env package
move the concrete job implementation to separate folder
2018-03-14 18:24:53 +08:00
Steven Zou
414c36205c Support API service of checking stats of the worker pool 2018-03-14 16:59:00 +08:00
Steven Zou
6b46844565 Add sweeper to clear the outdated data before the workerpool is starting 2018-03-14 15:52:00 +08:00
Daniel Jiang
0efd8e3c54
Merge pull request #4396 from ywk253100/180309_label_resource
Implement adding/removing labels to/from repositories and images API
2018-03-14 14:15:31 +08:00
Wenkai Yin
bcf81224ad Update according to the comments 2018-03-14 13:42:19 +08:00
Steven Zou
7b8971e930 Implement periodically enqueue job feature
add scheduler based on redis
add job wrapper for redis driver
other necessary modules
2018-03-13 23:58:07 +08:00
Wenkai Yin
36b9c4e458 Implement adding/removing labels to/from repositories and images API 2018-03-12 19:30:05 +08:00
Tan Jiang
b81b55b0c1 Extend the length of project name in request validation 2018-03-12 16:07:06 +08:00
yixingjia
ac05806dec Reload the attributes of Harbor db and Clair db when restart Harbor. (#4349) 2018-03-12 15:40:45 +08:00
Wenkai Yin
379f113452 Implement label management API 2018-03-09 12:17:27 +08:00
Wenkai Yin
685140cda8
Merge pull request #4375 from ywk253100/180308_smtp_tls
Do the authentication with CRAM-MD5 when the connection is insecure
2018-03-08 17:42:18 +08:00
pfh
e017f63103 Modify pagenation in Use, project name exist issue #4350 #4205 #4177 2018-03-08 16:25:24 +08:00
Wenkai Yin
0a8929b85e Do the authentication with CRAM-MD5 when the connection is insecure 2018-03-08 14:21:44 +08:00
Steven Zou
7a3c35d178 Implement the base framework of job service V2
add API server
add redis worker pool
add configuration loader
add bootstrap process
add vendor via dep
2018-03-08 13:16:57 +08:00
pfh
805e4aa4db Modify fileter problem and input length #4185 #4264 2018-03-07 17:01:00 +08:00
pfh
b2fb33ba0d Modify replication rule from page to dialog #4296 2018-03-07 10:03:08 +08:00
Tan Jiang
2f2bc7f3ef add ut 2018-03-01 18:52:09 +08:00
Tan Jiang
3a5bff1615 Refine error returned by Authenticator
There has been inconsistency in terms of the error returned by
authenticator.
This commit introduces an error ErrAuth to explicitly flag an
authentication failure, which should be treated as user error such
as "invalid credentials", and other errors will be treated as system error.
2018-03-01 18:19:46 +08:00
Tan Jiang
fc4e427c41 Return zero instead of error if the volume directory is not found at admin server 2018-02-28 13:52:33 +08:00
Daniel Jiang
ef54647749
Merge pull request #4230 from stonezdj/project_member_refactor2
Refactor project member
2018-02-27 14:33:26 +08:00
patfrat
3159e2c514 Add French ui_ng translation 2018-02-26 14:53:59 +01:00
stonezdj
4c6d1488bd Add UT 2018-02-09 15:29:08 +08:00
stonezdj
f138067242 Refactor project member 2018-02-09 10:38:51 +08:00
Daniel Jiang
bd12a3f958
Merge pull request #4235 from ywk253100/180206_godep
Specify the versions of packages used in golang dep
2018-02-08 12:38:02 +08:00