Upstream/harbor
1
0
Fork 0
mirror of https://github.com/goharbor/harbor.git synced 2024-11-29 21:54:13 +01:00
Code Issues Projects Releases Wiki Activity
10,162 Commits 53 Branches 317 Tags 335 MiB
923a538570
Commit Graph

4692 Commits

Author SHA1 Message Date
Daniel Jiang
fc94da54c1
Merge pull request #13728 from heww/fix-ut-for-get-reserved-resources 
test(quota): increase sleep time to fix fail of test
 2020-12-11 12:49:01 +08:00
Wenkai Yin(尹文开)
a4f21b1d85
Merge pull request #13694 from kofj/ghcr-provider 
GHCR Provider
 2020-12-11 09:41:10 +08:00
He Weiwei
2e09e54b38 test(quota): increase sleep time to fix fail of test 
Increase the sleep time to fix the fail in TestGetReservedResources of
quota

Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2020-12-10 11:23:47 +00:00
wang yan
1bb79d402d update code per review comments 
Signed-off-by: wang yan <wangyan@vmware.com>
 2020-12-10 16:08:52 +08:00
Daniel Jiang
60e3668d43 Support admin group in http authproxy 
This commit adds admin_groups into the configuration of http_auth
settings, it's a string in the form of "group1, group2".  If the token
review result shows the user is in one of the groups in the setting he
will have the administrator role in Harbor.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2020-12-10 15:57:15 +08:00
Wang Yan
dba5522d0b Migrate to task manager (#129) 
1, remove the gc to new programming model
2, move api define to harbor v2 swagger
3, leverage task & execution manager to manage gc job schedule, trigger and log.

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-12-10 14:00:33 +08:00
sluetze
5584e55070 fixed small typos in variable names 
Signed-off-by: sluetze <13255307+sluetze@users.noreply.github.com>
 2020-12-09 15:24:22 +01:00
DQ
85bf88c74e Add test case exporter 
- cache ut
- cli ut
- project collector ut
- system collector ut

Signed-off-by: DQ <dengq@vmware.com>
 2020-12-09 21:47:29 +08:00
DQ
d95f22448c Add cache for exporter 
Add timed cache for exporter
default cache time is 30s, cleanup job run every 4 hours

Signed-off-by: DQ <dengq@vmware.com>
 2020-12-09 21:22:40 +08:00
DQ
ade69e20ef Fix typo 
Signed-off-by: DQ <dengq@vmware.com>
 2020-12-09 20:42:21 +08:00
DQ
e6b53593ee Add exporter to harbor 
- add main file
- add pkg file
- update go.mod
- update vendor

Signed-off-by: DQ <dengq@vmware.com>
 2020-12-09 20:42:14 +08:00
Steven Zou
c12664122c fix(api):update stop job api 
- update StopJob() of basic worker
- update UnSchedule() of basic scheduler
- update the policy store to get more data

fix #13599 , fix #13597

Signed-off-by: Steven Zou <szou@vmware.com>
 2020-12-09 20:42:01 +08:00
Steven Zou
4acb708938
Merge pull request #13705 from steven-zou/fix/js_api 
fix(api):update stop job api
 2020-12-09 13:41:58 +08:00
Will Sun
13900df810
Merge pull request #13710 from AllForNothing/ut-case 
Fix UI UT failure
 2020-12-09 12:13:34 +08:00
AllForNothing
2f2e85577d Fix UI UT failure 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-12-09 11:33:55 +08:00
fanjiankong
2898117411 GHCR Provider 
Signed-off-by: fanjiankong <fanjiankong@tencent.com>
 2020-12-09 09:54:04 +08:00
Steven Zou
85783f3c0c fix(api):update stop job api 
- update StopJob() of basic worker
- update UnSchedule() of basic scheduler
- update the policy store to get more data

fix #13599 , fix #13597

Signed-off-by: Steven Zou <szou@vmware.com>
 2020-12-08 23:15:05 +08:00
He Weiwei
e92674a42a
feat: add cache library and enable it in config manager (#13525) 
Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2020-12-08 17:40:03 +08:00
疯魔慕薇
9f8a743da9 Tecent TCR Provider 
1. Docker image registry.
2. Helm chart registry.

Signed-off-by: 疯魔慕薇 <kfanjian@gmail.com>
Signed-off-by: fanjiankong <fanjiankong@tencent.com>
 2020-12-08 15:44:18 +08:00
AllForNothing
7cddb5845f Improve refresh secret page for robot account UI 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-12-08 13:42:32 +08:00
stonezdj(Daojun Zhang)
ec2f251d63
Merge pull request #13685 from wy65701436/robot-name-conflict 
fix robot name conflicate issue
 2020-12-07 11:18:49 +08:00
Wenkai Yin(尹文开)
65b6ae08bb
Merge pull request #13618 from mmpei/official-feature-artifact-hub 
Support replicate from artifact hub
 2020-12-07 10:47:05 +08:00
Daniel Jiang
fef5317aef
Merge pull request #13382 from flaviodsr/fix_core_init 
Fix deadlock on harbor-core initialization
 2020-12-04 19:51:56 +08:00
Will Sun
0840a10752
Merge pull request #13615 from AllForNothing/too-much-tag 
Add limitation to artifact tags
 2020-12-04 15:47:37 +08:00
AllForNothing
6e52fbdf71 Add system robot accout UI 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-12-04 14:19:36 +08:00
Wang Yan
e3a353d8ae fix robot name conflicate issue 
add project name into project level robot account name

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2020-12-04 12:40:59 +08:00
Wang Yan
d2fa2e6b84
update robot secret (#13654) 
* update robot secret

1, use SHA256 to generate and validate robot secret instread of symmetric encryption.
2, update the patch input object

Signed-off-by: Wang Yan <wangyan@vmware.com>

* update robot secret

1, use SHA256 to generate and validate robot secret instread of symmetric encryption.
2, update the patch input object

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2020-12-03 18:13:06 +08:00
Daniel Jiang
73c3f7c7ea Fix the pattern to match v2 catalog URI 
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2020-12-03 12:53:04 +08:00
Wenkai Yin(尹文开)
ddb29f2243
Set timezone as UTC for database connection (#13661) 
Set timezone as UTC for database connection

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-12-03 08:55:48 +08:00
Wenkai Yin(尹文开)
7e289e67ca
Merge pull request #13666 from reasonerjt/bump-up-goldap 
Bump up go-ldap to v3.2.4
 2020-12-02 18:15:00 +08:00
Daniel Jiang
34d776b062 Bump up go-ldap to v3.2.4 
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2020-12-02 15:28:54 +08:00
Will Sun
dbec54573c
Merge pull request #13511 from sluetze/12807-i18n-de-de 
[i18n] added support for German
 2020-12-02 13:42:52 +08:00
Qian Deng
688dc3af70
Merge pull request #13652 from ninjadq/fix_metric_inc_with_huge_num 
Fix instrumenting handler nest issue
 2020-12-01 20:23:41 +08:00
Daniel Jiang
0edbc0db75
Merge pull request #13641 from reasonerjt/v2-auth-host 
Consider the default port when comparing the hosts
 2020-12-01 18:55:34 +08:00
Wang Yan
732e9a21cd
updates on robot accounts (#13623) 
* updates on robot accounts

1, add patch method to refresh secret of a robot
2, fix robot account update issue
3, add editable attribute to handle the version 1 robot account
4, add duration for robot account
5, hide secret for get/list robot account

Signed-off-by: wang yan <wangyan@vmware.com>

* update code per review comments

1, change expirate creation func to AddDate().
2, remove the scanner duration specification, use the default value.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2020-12-01 18:31:34 +08:00
DQ
72ff33f80b Fix instrumenting handler nest issue 
remove nested handler for instrumenting

Signed-off-by: DQ <dengq@vmware.com>
 2020-12-01 17:12:19 +08:00
Steven Zou
2b65f7eb4b
Merge pull request #13534 from bitsf/fix_redis_sentinel_chart 
fix(redis) redis sentinel for chart cache
 2020-12-01 16:56:24 +08:00
Daniel Jiang
413dad98a8 Consider the default port when comparing the hosts 
This commit cover the cases when the port is set in one of the Host of
request or the core URL, to make sure the comparison works as expected
when the default port (80, 443) is added in only one of them.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2020-12-01 16:48:28 +08:00
AllForNothing
b0ec990ce6 Fix null pointer exception for auth guard 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-11-30 22:55:11 +08:00
Wang Yan
8cbfa6f382
add with details option for list project (#13634) 
default is true and doesn't break any existing api, and when to set it to false, the api only return the basic project infor
without meta, CVE settings and etc of the project.

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-11-30 16:13:07 +08:00
Qian Deng
b80b1a7abf
Merge pull request #13617 from ninjadq/remove_clair_in_harbor_code 
Remove clair code in harbor
 2020-11-30 15:28:02 +08:00
Daniel Jiang
db8ce49133
Rework systeminfo API. (#13606) 
This commit rework the systeminfo API under new programming model.
Also fixes #9149

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2020-11-30 14:15:18 +08:00
sluetze
33fe276114 added support for german 
Signed-off-by: sluetze <13255307+sluetze@users.noreply.github.com>
 2020-11-27 16:43:31 +01:00
DQ
590212b485 Remove clair related code 
- clair code in harbor core
- clair code in frontend
- clair code in robotcase

Signed-off-by: DQ <dengq@vmware.com>
 2020-11-27 14:01:04 +08:00
stonezdj(Daojun Zhang)
dec12308a1
Merge pull request #13621 from stonezdj/201127_fail_to_add_ldap_group 
Lowercase the LDAP DN in UnderBaseDN
 2020-11-27 11:45:07 +08:00
stonezdj(Daojun Zhang)
5a34f4e8fa
Merge pull request #13548 from wy65701436/robot2-swagger-api-dev 
add robot account 2 api handler
 2020-11-27 11:32:24 +08:00
Ziming Zhang
e44d58ee41 fix(redis) redis sentinel for chart cache 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2020-11-27 11:08:38 +08:00
stonezdj
ca245d3545 Lowercase the LDAP DN in UnderBaseDN 
Fixes #13362: Unable to add LDAP group with different letter case in DN

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2020-11-27 10:30:19 +08:00
peimingming
186109162b Support replicate from artifact hub 
Signed-off-by: peimingming <peimingming@corp.netease.com>
 2020-11-26 21:41:24 +08:00
Daniel Jiang
fd54a568d0
Merge pull request #13500 from thechristschn/fix-searchgroupbyname 
Fix api ldap group search by name
 2020-11-26 16:38:13 +08:00
AllForNothing
4390b2f259 Add limitation to artifact tags 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-11-26 14:39:33 +08:00
Wang Yan
02846194e0 parent 8e61a3ea31 
author Wang Yan <wangyan@vmware.com> 1605849192 +0800
committer Wang Yan <wangyan@vmware.com> 1606361046 +0800

update code per review comments

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-11-26 14:10:12 +08:00
Wang Yan
8e61a3ea31 add robot account 2 api handler 
Signed-off-by: Wang Yan <wangyan@vmware.com>
 2020-11-26 11:10:05 +08:00
stonezdj(Daojun Zhang)
90c5505430
Merge pull request #13591 from heww/fix-issue-13387 
fix(quota): ignore the fail when getting reference of quota
 2020-11-25 15:09:22 +08:00
He Weiwei
eb38180483 fix(quota): ignore the fail when getting reference of quota 
1. Clean the dirty data in quota/quota_usage.
2. Ignore the fail when getting the reference of quota.

Closes #13387

Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2020-11-24 14:50:38 +00:00
Will Sun
039722c518
Merge pull request #13585 from AllForNothing/proxy 
Add new supported registries for proxy cache on UI
 2020-11-24 16:45:07 +08:00
Will Sun
fc4a6fdd7b
Merge pull request #13496 from AllForNothing/rep-cron 
Improve adding replication rule page
 2020-11-24 16:16:37 +08:00
AllForNothing
69b5722cef Add new supported registries for proxy cache on UI 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-11-24 15:56:18 +08:00
Wenkai Yin(尹文开)
fe8b628f0c
Merge pull request #13437 from ywk253100/200929_replication 
Refactor the replication execution
 2020-11-24 10:38:22 +08:00
Steven Zou
35a0fc7afd
Merge pull request #13330 from chlins/fix/scanner-apikey-authorization 
fix: fix scanner apikey type match error
 2020-11-23 17:06:35 +08:00
Wenkai Yin
294385c34d Refactor the replication execution 
1. Use the task manager to manage the underlying execution/task
2. Use the pkg/scheduler to schedule the periodical job
3. Apply the new program model
4. Migration the old data into the new data model

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-11-23 14:24:10 +08:00
Daniel Jiang
3536a5dfac
Merge pull request #13452 from ninjadq/fix_status_code_issue_on_metrics 
Fix status code in metrics issue
 2020-11-23 10:37:47 +08:00
Daniel Jiang
00c941a413
Merge pull request #13557 from heww/fix-issue-13556 
fix: remove auto re-readable body in BeforeRequest
 2020-11-23 01:08:52 +08:00
He Weiwei
f733f95300 fix: remove auto re-readable body in BeforeRequest 
Remove nop close body in the BeforeRequest helper function.
Middleware must make the request body re-readable itself when it wants
read the body in the middleware.

Closes #13556

Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2020-11-20 01:41:12 +00:00
Wang Yan
04c4354df9
add robot account version 2 controller (#13472) 
the controller is for the enhanced robot account

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2020-11-19 15:39:45 +08:00
Wenkai Yin(尹文开)
def782b6f8
Don't escape the name when doing the exact matching for tag (#13533) 
Don't escape the name when doing the exact matching for tag
Fixes #13106

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-11-18 14:34:48 +08:00
DQ
a6edf51574 Fix status code in metrics issue 
Stauts code can't get from request. It shoud be recorded by a delegator

Signed-off-by: DQ <dengq@vmware.com>
 2020-11-17 19:53:06 +08:00
stonezdj(Daojun Zhang)
fb549b2d9e
Merge pull request #13444 from wy65701436/robot2-self-mgr 
add robot mgr
 2020-11-16 11:33:33 +08:00
Christian Baumann
4530e9feee Fix api ldap group search by name 
Signed-off-by: Christian Baumann <thechristschn@gmail.com>
 2020-11-12 23:01:02 +00:00
sshijun
3d526e220c Improve adding replication rule page 
Signed-off-by: sshijun <sshijun@vmware.com>
 2020-11-12 18:17:26 +08:00
He Weiwei
76f1afbe0d
refactor: remove core/promgr pkg (#13408) 
* refactor: remove core/promgr pkg

Remove `core/promgr` package and use `controller/project` instead of it.

Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2020-11-12 15:33:13 +08:00
Wang Yan
3550b5e5e9 add robot mgr 
the robot account manager to handle the CRUD

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-11-11 13:47:03 +08:00
stonezdj(Daojun Zhang)
ca8cb87790
Merge pull request #13439 from wy65701436/robot2-mgr 
add role permission manager for robot enhancement
 2020-11-11 10:35:10 +08:00
Will Sun
d32527dfd7
Merge pull request #13470 from AllForNothing/tooltp 
Fix tooltip bug for adding replication rule page
 2020-11-10 20:43:12 +08:00
Wang Yan
9723655378 update code per review comments 
1, rename table name to permission_policy
2, rename functions name

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2020-11-10 18:11:31 +08:00
Wang Yan
ec15e320bf add role permission manager for robot enhancement 
1, add two db tables of role permission and rbac policy
2, add manager of these two tables

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2020-11-10 16:49:29 +08:00
He Weiwei
ebc3443da9
Merge pull request #13474 from heww/fix-issue-11892 
fix: compute artifact size from db for schema1 manifest
 2020-11-10 16:20:39 +08:00
sshijun
bf99f6d5cd Fix tooltip bug for adding replication rule page 
Signed-off-by: sshijun <sshijun@vmware.com>
 2020-11-10 10:29:08 +08:00
Wenkai Yin
69ddb9c2a8 Downgrade the version of github.com/prometheus/client_golang to 1.7.1 to avoid the compile error in mac 
The version 1.8.0 of "github.com/prometheus/client_golang" bumps up lib "golang.org/x/sys" which referenced by "github.com/docker/docker@1.4.2". The changes of "golang.org/x/sys" causes the compile error in mac

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-11-10 08:49:03 +08:00
He Weiwei
9c8377909b fix: compute artifact size from db for schema1 manifest 
Closes #11892

Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2020-11-09 12:32:07 +00:00
Will Sun
039733b200
Merge pull request #13435 from AllForNothing/robot-prefix 
[UI]add robot name prefix
 2020-11-05 10:36:53 +08:00
He Weiwei
955431257c
Merge pull request #13422 from heww/disable-db-acess-for-ping 
feat: skip middlewares require db for ping
 2020-11-05 08:19:49 +08:00
stonezdj(Daojun Zhang)
7c1ad11763
Merge pull request #13425 from wy65701436/robot-prefix 
add robot name prefix
 2020-11-04 11:48:42 +08:00
Steven Zou
af7000d277
Merge pull request #13417 from bitsf/fix_gitlab_replication_task_num 
fix(replication) gitlab replication task num not correct
 2020-11-04 11:33:57 +08:00
Will Sun
c42ffe0915
Merge pull request #13410 from AllForNothing/helm-hub 
Add deprecated mark to Helm Hub
 2020-11-04 11:03:45 +08:00
Wang Yan
62208dc3e4 fix code conflict 
Signed-off-by: Wang Yan <wangyan@vmware.com>
 2020-11-03 09:42:37 -08:00
AllForNothing
ca93eb2218 Add robot name prefix to system setting UI 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-11-03 16:34:36 +08:00
Will Sun
e0617be15d
Merge pull request #13419 from AllForNothing/improve-ui 
Improve UI according to the designer's commonts
 2020-11-03 16:11:33 +08:00
Wang Yan
5a22019e3d add robot name prefix 
The system admin can set the prefix in configuration UI.

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-11-02 23:12:57 -08:00
AllForNothing
6452d38925 Add deprecated mark to Helm Hub 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-11-03 15:04:15 +08:00
DQ
ae80aa796e Upgrade Prometheus Client Version 
upgrade to v1.8.0

Signed-off-by: DQ <dengq@vmware.com>
 2020-11-03 14:33:11 +08:00
DQ
eb470501be Add metrics to Harbor Core 
1. Add configs in prepare
 2. Add models and config items in Core
 3. Encapdulate getting metric in commom package
 4. Add a middleware for global request to collect 3 metrics

Signed-off-by: DQ <dengq@vmware.com>
 2020-11-03 14:33:10 +08:00
Ziming Zhang
8c2c758677 fix(replication) gitlab replication task num not correct 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2020-11-03 10:55:46 +08:00
Wenkai Yin(尹文开)
99d818f4db
Merge pull request #13406 from mmpei/offical-replicate-chart-fix-20201031 
fix chart replication issue of uppercase letters
 2020-11-03 10:55:40 +08:00
He Weiwei
0c5aedb3d9 feat: skip middlewares require db for ping 
The ping endpoint will be blocked when DB conns reach the max open conns
of the sql.DB which will make ping request timeout,
so skip the middlewares which will require DB conn.

Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2020-11-03 01:58:59 +00:00
AllForNothing
58450c335f Improve UI according to the designer's commonts 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-11-02 17:17:35 +08:00
Wenkai Yin(尹文开)
dd3ffd4147
Merge pull request #13361 from bitsf/aws_adapter_namespace_check 
feature(replication) check namespace existing first for AWS adapter
 2020-11-02 16:56:50 +08:00
Will Sun
9a38dca1a6
Merge pull request #13401 from AllForNothing/label-selection 
Improve label selection for artifact list page
 2020-11-02 13:44:28 +08:00
peimingming
6394cc767e fix chart replication issue of uppercase letters 
Signed-off-by: peimingming <peimingming@corp.netease.com>
 2020-11-01 00:29:46 +08:00
疯魔慕薇
2bab4a10db
Merge pull request #13393 from chlins/fix/p2p-preheat-instance-and-policy-post-no-location 
fix(preheat): add location when create instance and policy
 2020-10-31 23:48:41 +08:00