Upstream/harbor
1
0
Fork 0
mirror of https://github.com/goharbor/harbor.git synced 2024-11-30 22:24:14 +01:00
Code Issues Projects Releases Wiki Activity
6,615 Commits 53 Branches 317 Tags 335 MiB
4e583ad65a
Commit Graph

2568 Commits

Author SHA1 Message Date
FangyuanCheng
f2316601d8 Fix duration missed for failed jobs 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-19 17:48:27 +08:00
Wenkai Yin
5c944d98d5 Fix bug found in replication 
Call filterResources direclty if resource isn't null in copy flow

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-19 17:32:50 +08:00
Steven Zou
e92164c886
Merge pull request #7442 from ywk253100/190418_replication_bug_fix 
Fix bug in replication
 2019-04-19 17:04:34 +08:00
stonezdj(Daojun Zhang)
36d13e8243
Merge pull request #7328 from stonezdj/debts 
Fix issue 6450 Test LDAP server error without save configuration
 2019-04-19 16:51:57 +08:00
Yuan Lei
8205e87d4d fix a small issue, that if there is no manifest in huawei image repository, should return false rather than err 
Signed-off-by: Yuan Lei <371304458@qq.com>
 2019-04-19 16:16:10 +08:00
Daniel Jiang
6b45b5ef7c
Merge pull request #7451 from reasonerjt/oidc-logout 
Skip verifying OIDC token for local user
 2019-04-19 14:55:26 +08:00
Steven Zou
38e6df4edb fix code style issues: missing comments 
Signed-off-by: Steven Zou <szou@vmware.com>
 2019-04-19 14:16:08 +08:00
Steven Zou
f8feaa192e add get scheduled and periodic executions APIs 
Signed-off-by: Steven Zou <szou@vmware.com>
 2019-04-19 13:54:23 +08:00
Wenkai Yin
cf5cd5902f Fix bug in replication 
1. Fix bug when creating the namespace
2. Keep the same logic for hiding access secret
3. Filter only push mode policies for event trigger

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-19 13:34:04 +08:00
Wenkai Yin
3738b0a984
Merge pull request #7439 from wy65701436/pin-error 
Pin pkg error version to v0.8.1
 2019-04-19 13:16:47 +08:00
Daniel Jiang
5292aea89e Skip verifying OIDC token for local user 
If a user does not have OIDC meta data in DB, it means he's not
onboarded via OIDC authn, hence, we should not check the token.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2019-04-19 13:07:06 +08:00
Steven Zou
d2c4f19a4c
Merge pull request #7450 from yuanshuhan/replication_ng 
add huawei adapter to replication module, and adjust some interface a…
 2019-04-19 12:52:21 +08:00
Wenkai Yin
059b75e97c
Merge pull request #7392 from reasonerjt/oidc-logout 
Handle OIDC user invalidation from OIDC provider.
 2019-04-19 12:46:36 +08:00
Fangyuan Cheng
efca5631fe
Merge pull request #7447 from pureshine/fix-bug 
Fix replication tasks page cannot pagination
 2019-04-19 12:10:50 +08:00
FangyuanCheng
87c2684724 Fix replication tasks page cannot pagination 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-19 11:40:10 +08:00
Yuan Lei
7ee009f1d2 add huawei adapter to replication module, and adjust some interface after testing 
Signed-off-by: Yuan Lei <371304458@qq.com>
 2019-04-19 10:05:39 +08:00
Daniel Jiang
239b33c5fb Handle OIDC user invalidation from OIDC provider. 
Ths commmit ensures that when user's token is invalidated OIDC provider, he
cannot access protected resource in Harbor with the user info in his session.
We share the code path with secret verification b/c the refresh token
can be used only once, so it has to be stored in one place.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2019-04-19 01:27:31 +08:00
De Chen
4ce2ba8688 Support image delete in DockerHub adapter (#7422) 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-18 18:24:42 +08:00
De Chen
c3375e4ac2 Fix create ns failure in DockerHub (#7421) 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-18 18:24:28 +08:00
wang yan
d410a964a5 Pin pkg error version to v0.8.1 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-04-18 17:49:04 +08:00
Steven Zou
608354dd04 refine the returnning errors 
Signed-off-by: Steven Zou <szou@vmware.com>
 2019-04-18 17:15:55 +08:00
Steven Zou
16f97326ad
Merge pull request #7433 from goharbor/replication_ng 
Merge the replication ng branch to master
 2019-04-18 16:35:45 +08:00
FangyuanCheng
33852973e3 Hide vulnrability if clair is not installed 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-18 16:03:31 +08:00
Steven Zou
1f481e492c Refactor job servcie primary logic to fix related bugs 
Signed-off-by: Steven Zou <szou@vmware.com>
 2019-04-18 16:02:49 +08:00
FangyuanCheng
f7f5298ba2 Fix replication ui relate issues 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-18 15:06:11 +08:00
stonezdj
41a574e55c Fix issue 6450 Test LDAP server error without save configuration 
Signed-off-by: stonezdj <stonezdj@gmail.com>
 2019-04-18 14:24:21 +08:00
wang yan
ba76550d14 Disable throw internal error to UI 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-04-18 00:04:19 +08:00
慕薇疯魔
bf28e9779b 1. check is repository exist later at filterTags. 
2. test case for image not found.

Signed-off-by: 慕薇疯魔 <kfanjian@gmail.com>
 2019-04-17 23:01:44 +08:00
Wenkai Yin
7196abc77b
Merge pull request #7417 from pureshine/replication-case 
Reload the task list when the task status is pending and scheduled
 2019-04-17 20:03:36 +08:00
Wenkai Yin
a5cc228781
Merge pull request #7420 from ywk253100/190417_revert_local_harbor 
Update the migration sql
 2019-04-17 19:58:31 +08:00
Wenkai Yin
eb00c9cb70
Merge pull request #7404 from jwangyangls/replication_C 
In add or edit replication page ,disable the mode of pull and push when editing the replication and delete src_namespaces and delete useless code and add a validate content that when I choose scheduled, the cron field is mandatory.
 2019-04-17 19:11:46 +08:00
FangyuanCheng
f776e6de2c Reload the task list when the task status is pendding and scheduled 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-17 19:10:23 +08:00
wang yan
ddec7bd645 fix error handlering in job notification 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-04-17 18:19:01 +08:00
wang yan
e017294f71 merge with master latest 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-04-17 17:52:39 +08:00
Wenkai Yin
547c2337de Update the migration sql 
1. Update the migration sql
2. Rename the ResourceRepository from repository to image

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-17 17:18:03 +08:00
Yogi_Wang
8f152392b5 Change new and edit Replication page about pull and push mode. 
1.disable the mode of pull and push when editing the replication;
2.delete src_namespaces
3.delete useless code
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-04-17 16:57:03 +08:00
Wang Yan
a6af9e9972
Support well-formatted error returned from the REST APIs. (#6957) 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-04-17 16:43:06 +08:00
jwangyangls
cc868aa23e
Merge pull request #7407 from jwangyangls/fixHelmChartRouteIssue 
Recovery a test case about 'should filter data by keyword' in the test file named repository-gridview.component.spec.ts
 2019-04-17 15:24:56 +08:00
Wenkai Yin
6e0d892963 Support creating project with service account 
This commit introduces a solution to workaround the restriction of project creation API: only normal users can create projects

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-17 14:50:32 +08:00
Wenkai Yin
3f7884d9d2 Revert "Add new registry type: LocalHarbor" 
This reverts commit 94cacf762a.

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-17 14:50:24 +08:00
Wenkai Yin
c754ec054d
Merge pull request #7406 from pureshine/remove-replication 
Remove the Replication tab under project view
 2019-04-17 11:01:23 +08:00
FangyuanCheng
73e408b851 Fix cron input box and select box not in one line 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-16 22:38:28 +08:00
Wenkai Yin
aa188954ed
Merge pull request #7403 from ywk253100/190416_prepare_for_push 
Update the PrepareForPush method
 2019-04-16 18:47:42 +08:00
FangyuanCheng
b11c95316f Remove the Replication tab under project view 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-16 17:56:45 +08:00
Wenkai Yin
ea6ca2b8cc
Merge pull request #7399 from ywk253100/190416_match 
Use the new package to do the match
 2019-04-16 17:25:51 +08:00
Wenkai Yin
613dfee5ee Update the PrepareForPush method 
Update the PrepareForPush method to avoid the useless API callings to create namespaces

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-16 17:21:31 +08:00
root
b60b16230e Use the new package to do the match 
Use the new package to do the match

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-16 16:07:30 +08:00
Wenkai Yin
0f488e6011
Merge pull request #7393 from pureshine/add-override 
Fix replication frontend issues
 2019-04-16 15:55:00 +08:00
FangyuanCheng
609f6cbda2 Fix replication frontend issues 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-16 15:20:05 +08:00
Wenkai Yin
94cacf762a Add new registry type: LocalHarbor 
The "LocalHarbor" is the type of registry where the replication service is running on

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-16 11:42:36 +08:00
Wenkai Yin
2f1d2257d5 Remove the namespace concept in replication 
Update the replication logic to remove the "namespace"

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-16 08:36:42 +08:00
慕薇疯魔
027cf44e82 unit test for native adapter. 
Signed-off-by: 慕薇疯魔 <kfanjian@gmail.com>
 2019-04-15 23:51:20 +08:00
慕薇疯魔
c5045933a1 change to testable. 
Signed-off-by: 慕薇疯魔 <kfanjian@gmail.com>
 2019-04-15 20:39:50 +08:00
Wenkai Yin
7729bca23b
Merge pull request #7382 from wy65701436/replication_ng 
Add event trigger to helm deletion replication
 2019-04-15 20:36:10 +08:00
wang yan
7a373c2eed Add event trigger to helm upload/deletion replication 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-04-15 19:02:33 +08:00
Wenkai Yin
d9a2b2b79a
Merge pull request #7380 from cd1989/anonymous-dockerhub 
Support anonymous access to dockerhub
 2019-04-15 18:41:02 +08:00
Wenkai Yin
24e7019b60
Merge pull request #7384 from kofj/fix_deadlock 
fix deadlock when client not exist.
 2019-04-15 18:40:10 +08:00
Yogi_Wang
4faea92b04 Release a test case about 'should filter data by keyword' 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-04-15 17:00:27 +08:00
FangyuanCheng
a95cf813fb Fix when editting the policy, the source registry isn’t shown 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-15 16:17:20 +08:00
慕薇疯魔
47d6e2583a fix deadlock when client not exist. 
Signed-off-by: 慕薇疯魔 <kfanjian@gmail.com>
 2019-04-15 16:12:42 +08:00
cd1989
21c7554644 Support anonymous access to dockerhub 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-14 16:44:24 +08:00
Wenkai Yin
00ecbd459e Fix buf in native docker registry adapter 
Check the existence of repository if the name filter contains no * and ?

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-14 14:50:44 +08:00
慕薇疯魔
64cabc0dfc fix #7219 
Signed-off-by: 慕薇疯魔 <kfanjian@gmail.com>
 2019-04-13 22:44:20 +08:00
慕薇疯魔
086926b745 format. 
Signed-off-by: 慕薇疯魔 <kfanjian@gmail.com>
 2019-04-13 22:33:43 +08:00
Wenkai Yin
ba038eb883 Support replication all projects in Harbor 
Support replication all projects in Harbor

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-13 20:23:19 +08:00
Wenkai Yin
c222f18fa7 Update replication 
1. Refine the health check of docker hub
2. Remove the GetNamespace method from adapter interface

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-13 15:20:06 +08:00
Daniel Jiang
f92bc8076d "Skip verify cert" to "verify cert" 
This commit tweaks the attribute for auth proxy mode and OIDC auth mode.
To change it from "Skip verify cert" to "verify cert" so they are more
consistent with other modes.
Additionally it removes a workaround in `SearchUser` in auth proxy
authenticator.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2019-04-12 23:25:54 +08:00
Wenkai Yin
1d16e18dff Remove "ng" from source code 
Remove "ng" from source code

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-12 22:42:27 +08:00
Wenkai Yin
d4b6eede98
Merge pull request #7331 from cd1989/ng-operation-review 
Correct some typos and do some small adjustments
 2019-04-12 21:50:42 +08:00
cd1989
8ca5e17c58 Correct some typos and do some small adjustments 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-12 21:17:33 +08:00
慕薇疯魔
a555b09df0 1. Implement native docker registry adapter. 
2. register the native adapter.

Signed-off-by: 慕薇疯魔 <kfanjian@gmail.com>
 2019-04-12 21:08:23 +08:00
Wenkai Yin
f0f92791c7
Merge pull request #7333 from cd1989/check-status-when-add-registry 
Check health status when add registry
 2019-04-12 20:39:44 +08:00
Wenkai Yin
5ee30c7909
Merge pull request #7127 from cd1989/dockerhub-adaptor 
Implement dockerhub adapter
 2019-04-12 20:25:18 +08:00
cd1989
7f6f85aab3 Remove ValidResource method 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-12 19:47:27 +08:00
Wenkai Yin
c88eeef07c
Merge pull request #7360 from ywk253100/190412_case 
Remove the E2E test cases for replication
 2019-04-12 18:44:16 +08:00
Wenkai Yin
174a1f5bfa Remove the E2E test cases for replication 
Remove the E2E test cases for replication

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-12 17:37:14 +08:00
cd1989
cc4f08cc04 Add valid method to adapter to valid resource 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-12 17:33:32 +08:00
cd1989
1231c533db Support name and tag filters 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-12 17:31:32 +08:00
cd1989
ca705275f2 Support pull based replication from Dockerhub 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-12 17:31:32 +08:00
cd1989
b876a576a6 Implement dockerhub adapter 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-12 17:31:32 +08:00
cd1989
a9fa22269c Check health status when add/update registry 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-12 17:29:05 +08:00
Wenkai Yin
271c5ab213
Merge pull request #7357 from ywk253100/190412_harbor_adapter 
Add filter support when fetching resources for Harbor adapter
 2019-04-12 15:51:58 +08:00
Wenkai Yin
7d4649fc6b
Merge pull request #7163 from yuanshuhan/replication_ng 
huawei cloud registry adapter for replication
 2019-04-12 15:32:23 +08:00
Wenkai Yin
04883d2b0d Support replication windows images 
Skip the foreign layers when do the replication

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-12 15:28:41 +08:00
Wenkai Yin
2fe207b77d Add filter support when fetching resources for Harbor adapter 
Add filter support when fetching resources for Harbor adapter

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-12 15:28:41 +08:00
Yogi_Wang
8b82e8925e Add Token Review Endpoint in configuration page 
adding token review endpoint to the configuration page allows users to edit token review endpoint when logging in through http auth.

Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-04-12 14:29:39 +08:00
Yuan Lei
f8cb2d1e86 huawei cloud adapter for replication 
Signed-off-by: Yuan Lei <yuanlei9@huawei.com>
 2019-04-12 11:18:23 +08:00
Wenkai Yin
188d66d875
Merge pull request #7350 from ywk253100/190411_bugfix 
Fix bug of replication
 2019-04-12 08:22:59 +08:00
Wenkai Yin
bc0123662b Fix bug of replication 
1. check the disable/enable status before starting the replication
2. process the support_namespace property

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-12 07:59:57 +08:00
Wenkai Yin
1f574e7d10
Merge pull request #7354 from wy65701436/replication_ng_namespace 
Add api to get namespaces of registry
 2019-04-11 23:44:24 +08:00
wang yan
117c36d52c Add api to get namespaces of registry 
To query the namespace of the registry according to its ID.

Signed-off-by: wang yan <wangyan@vmware.com>
 2019-04-11 23:17:33 +08:00
Daniel Jiang
83a2246485
Merge pull request #7335 from reasonerjt/oidc-onboard-e2e 
OIDC E2E flow + secret support
 2019-04-11 18:13:22 +08:00
Wenkai Yin
a2fcb41b31 Fix bug in ping registry API 
Fix bug in ping registry API: accept both ID and other properties

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-11 18:00:44 +08:00
jwangyangls
08ecb87220
Merge pull request #7336 from jwangyangls/loginPageChange 
Change the login module
 2019-04-11 17:00:34 +08:00
Daniel Jiang
763c5df010 Add UT 
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2019-04-11 15:30:19 +08:00
Wenkai Yin
b73acde051 Support the migration for scheduled replication rule from previous version of Harbor 
Support the migration for scheduled replication rule from previous version of Harbor

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-11 13:14:32 +08:00
Yogi_Wang
94438608a7 Add Cli secret in Harbor user profile 
user could copy the CLI secret when login through oidc, and using this cli secret as password when using docker/helm cli to access Harbor.

Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-04-11 12:52:15 +08:00
Wenkai Yin
5a047a7eb6 Update the adapter interface 
Add ConvertResourceMetadata and PrepareForPush methods

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-10 23:37:11 +08:00
zhoulin xie
cff4df8dfd request change 
Signed-off-by: zhoulin xie <zhoulin.xie@daocloud.io>
 2019-04-10 22:37:02 +08:00
Daniel Jiang
0d18e6c82f Update according to comments 
For more context see PR #7335

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2019-04-10 19:38:12 +08:00
Daniel Jiang
0a2343f542 Support secret for docker CLI 
As CLI does not support oauth flow, we'll use secret for help OIDC user
to authenticate via CLI.
Add column to store secret and token, and add code to support
verify/refresh token associates with secret.  Such that when the user is
removed from OIDC provider the secret will no longer work.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2019-04-10 19:38:11 +08:00
Daniel Jiang
08e00744be Fix misc bugs for e2e OIDC user onboard process 
This commit adjust the code and fix some bugs to make onboard process
work.
Only thing missed is that the UI will need to initiate the redirection,
because the request of onboarding a user was sent via ajax call and didn't
handle the 302.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2019-04-10 19:38:11 +08:00
Yogi_Wang
5df1542c22 Change the login module 
change the login module to fix the issue that the nav is being in page when we login harbor again

Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-04-10 14:27:51 +08:00
Meina Zhou
46f78906f7 modify filter to show all the filters in once 
Signed-off-by: Meina Zhou <meinaz@vmware.com>
 2019-04-10 11:15:40 +08:00
Wenkai Yin
7fcc391fed
Merge pull request #7322 from cd1989/update-with-props 
Update only specific props in registry update
 2019-04-10 09:44:51 +08:00
Wenkai Yin
2644c52926
Merge pull request #7302 from pureshine/registry-update 
Fix replication ui related issues
 2019-04-09 20:55:44 +08:00
Wenkai Yin
dba9822477
Merge pull request #7323 from zhoumeina/replication_ng 
modify filter to show all the filters in once
 2019-04-09 20:54:44 +08:00
cd1989
2ad8913e84 Update only specific props in registry update 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-09 19:57:21 +08:00
FangyuanCheng
e76c287a0c Fix replication ui related issues 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-09 17:44:42 +08:00
Wenkai Yin
5a65480594 Handle the policy from previous versions 
Handle the policy from previous versions

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-09 17:43:07 +08:00
Meina Zhou
4dac7464cb modify filter to show all the filters in once 
Signed-off-by: Meina Zhou <meinaz@vmware.com>
 2019-04-09 17:28:36 +08:00
Wenkai Yin
580674f3da Merge remote-tracking branch 'upstream/master' into 190409_sync 2019-04-09 17:01:09 +08:00
Wenkai Yin
9e5e723855 Add unit test cases for Harbor adapter 
Add unit test cases for Harbor adapter

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-09 13:04:04 +08:00
Wenkai Yin
855c0a2a6e
Merge pull request #7194 from stonezdj/remove_error_msg 
Remove error message of saving system setting to db
 2019-04-09 12:02:17 +08:00
Wenkai Yin
d72a53aa0c
Merge pull request #7318 from ywk253100/190408_upgrade 
Upgrade the replication_job table
 2019-04-08 22:43:40 +08:00
Wenkai Yin
4ffa0c3da0 Upgrade the replication_job table 
This commit migrates the replication_job table, add one execution record and one task record for each job

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-08 22:23:53 +08:00
stonezdj
e8ab7156bc Remove error message of saving system setting to db 
Signed-off-by: stonezdj <stonezdj@gmail.com>
 2019-04-08 18:16:18 +08:00
Yogi_Wang
eec55f18eb Add OIDC onboard page redirect to Harbor url when we login from OIDC and add redirect page address when we login again after logout 
1.when we are the first time we login harbor page when we login from OIDC  ,we add the url in onboard-add-username  page.
2.fix the part of issue that we cannot redirect to de origin page when we login

Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-04-08 16:30:32 +08:00
Wenkai Yin
ee6eb41dae
Merge pull request #7303 from zhoumeina/replication_ng 
fix frontend issues
 2019-04-08 15:50:21 +08:00
Wenkai Yin
7ff46acd25
Merge pull request #7289 from cd1989/add-registry-ping 
Add registry ping API
 2019-04-08 14:08:53 +08:00
cd1989
5a2d03593f Add helth check method to registry adapter 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-08 10:03:28 +08:00
Wenkai Yin
462aab5a1e
Merge pull request #7307 from cd1989/registry-healthchecker 
Wait randomly before registry health checking
 2019-04-08 07:11:49 +08:00
cd1989
f71a110bec Add registry ping API 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-06 17:00:52 +08:00
cd1989
07139684ce Wait randomly before registry health checking 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-05 20:46:29 +08:00
Wenkai Yin
e8fe2aa60c Upgrade the registry and replication policy tables 
Upgrade the registry and replication tables in database

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-05 13:25:00 +08:00
cd1989
fe004e1bfc Init replication in core 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-04 21:58:31 +08:00
cd1989
2450dacecb Use policy controller in registry deletion 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-04 21:26:27 +08:00
Wenkai Yin
4116433de8
Merge pull request #7306 from ywk253100/190404_cleanup 
Remove the useless replication code
 2019-04-04 21:18:04 +08:00
Wenkai Yin
c2f702be2a Remove the useless replication code 
This commit removes the useless replication code

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-04 20:56:25 +08:00
Wenkai Yin
58a73de3e5
Merge pull request #7299 from ywk253100/190404_sync 
Sync with master branch
 2019-04-04 17:33:11 +08:00
Meina Zhou
0028dc0d62 fix frontend issues 
Signed-off-by: Meina Zhou <meinaz@vmware.com>
 2019-04-04 17:08:59 +08:00
Wenkai Yin
dc35be09c4
Merge pull request #7301 from ywk253100/190404_agent 
Filter the events triggerred by replication
 2019-04-04 16:50:23 +08:00
Wenkai Yin
02dd4e500a Clear up the table before doing dao test 
Clear up the table before doing dao test

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-04 16:46:16 +08:00
Wenkai Yin
1c735a7464 Filter the events triggerred by replication 
Filter the events triggerred by replication pull

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-04 16:03:38 +08:00
jwangyangls
ca846ad031
Merge pull request #7297 from jwangyangls/fix_oidc_ui_save 
Fix issue of oidc configuration save button is always disabled.
 2019-04-04 15:56:06 +08:00
Wenkai Yin
b66b1f341e Merge remote-tracking branch 'upstream/master' into 190404_sync 2019-04-04 14:55:09 +08:00
Wenkai Yin
78fc2846bd Stop a replication execution 
Implement the function to support to stop the replication execution

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-04 14:51:37 +08:00
Yogi_Wang
311af5d217 Fix issue of oidc configuration save button is always disabled and incorrect character 
when we login Harbor width OIDC ,we cannot click the save  button of oidc config page

Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-04-04 14:34:18 +08:00
jwangyangls
a27df46fb6
Merge pull request #7292 from jwangyangls/fix_login_robot_issue 
Fix nightly test case failed when login harbor.
 2019-04-04 12:14:43 +08:00
Yogi_Wang
4416e1810e fix login harbor issue with test case 
Solve the problem that when we log on to the harbor page, the automation test will click on an incorrect button, which results in the test page being unable to log in.

Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-04-04 09:58:46 +08:00
Wenkai Yin
3ed8d87406
Merge pull request #7294 from pureshine/replication-ui 
Fix cannot search for replication tasks
 2019-04-04 09:52:04 +08:00
Wenkai Yin
48f02d0605
Merge pull request #7291 from cd1989/registry-with-empty-credential 
Handle registry with empty credential
 2019-04-03 21:35:32 +08:00
Yan
da0e20ec60
Add controller to onboard oidc user (#7286) 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-04-03 20:47:22 +08:00
cd1989
e2c86f8f59 Handle registry with empty credential 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-03 20:33:26 +08:00
cd1989
8968e82675 Allow edit registry description 
Signed-off-by: cd1989 <chende@caicloud.io>
 2019-04-03 19:47:14 +08:00
Fangyuan Cheng
89b72906f4
Merge branch 'master' into move-scan/gc 2019-04-03 16:07:35 +08:00
Meina Zhou
6b3f2bbf74 modify frontend replication UI to apply api changes. use dest registry as object 
Signed-off-by: Meina Zhou <meinaz@vmware.com>
 2019-04-03 15:45:42 +08:00
FangyuanCheng
8a1f3b7c00 Fix cannot search for replication tasks 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-03 15:38:18 +08:00
Wenkai Yin
0c171c642b
Merge pull request #7244 from wy65701436/oidc_user 
add the dao funcs for OIDC onboard user
 2019-04-03 15:23:05 +08:00
FangyuanCheng
82716d492d move vulnerability and gc ui 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-03 14:39:46 +08:00
jwangyangls
beeb8b53d7
Merge pull request #7281 from jwangyangls/oidc_step3_onboard_tpl 
Add the OIDC onboard page
 2019-04-03 14:11:25 +08:00
wang yan
dcf1d704e6 fix dao UT issue and refine the error of onboard OIDC user 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-04-03 14:05:18 +08:00
jwangyangls
cf391e74ad
Merge pull request #7267 from jwangyangls/oidc_step2_onboard 
Add links to OIDC login
 2019-04-03 13:18:18 +08:00
Yogi_Wang
3bf644012c Add the OIDC onboard page 
When a user logs in to Harbor for the first time through OIDC, the user will enter an onboard page, prompting the user to add the user name of Harbor. After the user name is entered, click save, and the user successfully logs in to Harbor through OIDC.

Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-04-03 12:58:11 +08:00
Yogi_Wang
da3620816f Add links to OIDC login 
In the login page ,we add button to jump to OIDC login page.

Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-04-03 12:33:18 +08:00
wang yan
41018041f7 remove oidc controller and add more UTs 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-04-03 09:54:21 +08:00
Yan
0de5999f52 add the controller for ocdi onboard user 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-04-03 09:52:22 +08:00
Wenkai Yin
5219073c49 Call Harbor API to delete the images in Harbor adapter 
Call Harbor API to delete the images in Harbor adapter to avoid the inconsistent between the different versions of Harbor

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-02 17:02:15 +08:00
Wenkai Yin
4484bca756 Fix replication related issues 
1. Add operation property for tasks
2. Add trigger property for executions
3. Update the getting registry info API to allow passing 0 as ID to get the info of local Harbor registry

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-02 14:26:17 +08:00
Wenkai Yin
8d6299fed9
Merge pull request #7257 from reasonerjt/oidc-controllers-p2 
Add callback controller for OIDC
 2019-04-02 13:37:00 +08:00
Wenkai Yin
18dbd807a4
Merge pull request #7270 from ywk253100/190401_transport 
Provide a util function to return a common HTTP transport
 2019-04-02 07:24:53 +08:00
Wenkai Yin
b42ae1c994 Provide a util function to return a common HTTP transport 
1. Provide a util function to return a shared HTTP transport
2. Read secretkey from the configuration of replication

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-01 19:52:37 +08:00
Wenkai Yin
74efee569e Update the registry client to support pulling public images from docker hub without login 
Only add the authentication info when the username is provided to support pulling public images from docker hub without login

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-01 19:15:07 +08:00
Wenkai Yin
df2ae63308
Merge pull request #7262 from ywk253100/190401_harbor_adapter 
Use the secret to auth the replication for local Harbor
 2019-04-01 17:26:56 +08:00
Wenkai Yin
bd2308b91a Use the secret to auth the replication for local Harbor 
1. Use the secret to do the auth between the components when replicating
2. Handle internal core URL and token service URl when the instance is local Harbor

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-01 16:24:06 +08:00
Wenkai Yin
d6eb700077
Merge pull request #7264 from mmpei/replication_ng_bugfix_endtime 
Fix execution end time bug
 2019-04-01 16:09:16 +08:00
peimingming
92488bd27e Fix execution end time bug 
Signed-off-by: peimingming <peimingming@corp.netease.com>
 2019-04-01 14:28:01 +08:00
Yogi_Wang
363d8dd208 Configuration enables users to change information after login through OIDC provider smoothly. 
In the configration auth mode section, we add an option, OIDC.When the user logs in using OIDC mode, the system defaults to auth mode to select OIDC, where the user can modify the name, endpoint, scope, clientId, clientSecret and skipCertVerify of the OIDC. After the modification, the user clicks the Save button to save the changes
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-04-01 13:13:02 +08:00
Daniel Jiang
587acd33ad Add callback controller for OIDC 
This commit add callback controller to handle the redirection from
successful OIDC authentication.
For E2E case this requires callback controller to kick off onboard
process, which will be covered in subsequent commits.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2019-04-01 12:35:31 +08:00
FangyuanCheng
cb438d0029 Update replication data 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-03-31 23:26:26 +08:00
Wenkai Yin
82e02fc734
Merge pull request #7254 from ywk253100/190329_api 
Update the replication API
 2019-03-30 21:28:38 +08:00
Wenkai Yin
71b706e60a Update the replication API 
1. Add getting execution by ID API
2. Return registry detail info in listing policies API

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-03-30 20:46:02 +08:00
FangyuanCheng
163909579e fix get adapter bug 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-03-29 18:27:00 +08:00
Wenkai Yin
1491cf1846
Merge pull request #7224 from pureshine/replication_ng 
Refactor replication-task page according to the new design
 2019-03-29 17:19:31 +08:00
FangyuanCheng
0b7f68388f Refactor replication-task page 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-03-29 15:33:42 +08:00
Wenkai Yin
8c7b63bac2
Merge pull request #7248 from ywk253100/190326_event 
Add event based trigger and scheduled trigger
 2019-03-29 14:58:09 +08:00
Wenkai Yin
4f8e283e8e Add event based trigger and scheduled trigger 
This commit implements the event based trigger and scheduled trigger in replilcation

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-03-29 13:48:34 +08:00
Fangyuan Cheng
a2051354c6
Merge pull request #7232 from pureshine/cron-validator 
Add cron regular expression
 2019-03-29 10:23:40 +08:00
Daniel Jiang
f6820b5ae3
Merge pull request #7242 from reasonerjt/oidc-controllers 
Add controller to handle oidc login
 2019-03-29 00:50:26 +08:00
FangyuanCheng
5dd200fa00 cron validator 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-03-28 13:25:25 +08:00
Daniel Jiang
9ce98f4acd Add controller to handle oidc login 
The controller will redirect user to the OIDC login page based on
configuration.
Additionally this commit add some basic code to wrap `oauth2` package
and `provider` in `go-oidc`, and fixed an issue in UT to make
InMemoryDriver for config management thread-safe.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2019-03-28 11:29:05 +08:00
Fangyuan Cheng
2787306d47
Merge pull request #7076 from cd1989/update-api-basepath 
Use baseURL from config
 2019-03-28 09:40:23 +08:00
Wenkai Yin
c0faa9d4aa
Merge pull request #7227 from zhoumeina/replication_ng 
add filter logic
 2019-03-28 08:43:43 +08:00
Wenkai Yin
0e9bdbc09c
Merge pull request #7225 from ywk253100/190326_structure 
Adjust the file structure of replication package
 2019-03-27 13:08:05 +08:00
Yan
03709e4ec1
add authn proxy (#7199) 
* add authn proxy docker login support

User could use the web hook token issued by k8s api server to login to harbor.
The username should add a specific prefix.

Signed-off-by: wang yan <wangyan@vmware.com>

* update code per review comments

Signed-off-by: wang yan <wangyan@vmware.com>

* Add UT for auth proxy modifier

Signed-off-by: wang yan <wangyan@vmware.com>
 2019-03-27 12:37:54 +08:00
Wenkai Yin
017bba8dc1 Merge remote-tracking branch 'upstream/master' into 190327_sync 2019-03-27 11:43:51 +08:00
Meina Zhou
d9bff2f269 add filter logic 
Signed-off-by: Meina Zhou <meinaz@vmware.com>
 2019-03-26 17:09:23 +08:00
Wenkai Yin
de4eb0369a Adjust the file structure of replication package 
Move the scheduler, execution, hook and flow package into operation

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-03-26 14:59:58 +08:00
Wenkai Yin
690f868d15
Merge pull request #7216 from zhoumeina/replication_ng 
Create replication rule -- remove project logic and add dynamic trigger logic.
 2019-03-26 10:39:05 +08:00
Mia ZHOU
542c460e3d
Merge pull request #7214 from jwangyangls/fixHelmChartIssue 
moveHelmChartIssue
 2019-03-26 10:25:37 +08:00
Meina Zhou
2df11a773e add trigger logic and remove project code 
Signed-off-by: Meina Zhou <meinaz@vmware.com>
 2019-03-25 14:19:47 +08:00
Fangyuan Cheng
37ddaf9ecf
Merge pull request #7138 from pureshine/vul-cron 
Refactoring vulnerability ui support cron
 2019-03-25 12:30:28 +08:00
Daniel Jiang
49aae76205 Onbard settings for OIDC provider (#7204) 
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2019-03-25 12:24:39 +08:00
Yogi_Wang
309696b575 movoHelmChartIssue 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-03-25 11:11:10 +08:00
Meina Zhou
b0ce3da8bd remove the project related code 
Signed-off-by: Meina Zhou <meinaz@vmware.com>
 2019-03-25 10:20:55 +08:00
FangyuanCheng
dada47c07e Refactoring vulnerability ui support cron 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-03-23 20:58:45 +08:00
Wenkai Yin
b37f4018a6 Update the registry adapter interface 
This commit adds the Info() method to the registry adapter interface

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-03-23 07:49:59 +08:00
Wenkai Yin
679b0d3d6a Convert job status to replication task status 
This commits converts job status to task status

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-03-22 18:16:27 +08:00
Wenkai Yin
39485efc9a
Merge pull request #7212 from ywk253100/190324_sync 
Sync with master branch
 2019-03-24 14:18:23 +08:00
Yan
8d3946a0e2
Refactor scan all api (#7120) 
* Refactor scan all api

This commit is to let scan all api using admin job to handle schedule
management. After the PR, GC and scan all share unified code path.

Signed-off-by: wang yan <wangyan@vmware.com>

* update admin job api code according to review comments

Signed-off-by: wang yan <wangyan@vmware.com>

* Update test code and comments per review

Signed-off-by: wang yan <wangyan@vmware.com>
 2019-03-22 17:52:21 +08:00