Commit Graph

11599 Commits

Author SHA1 Message Date
Wang Yan
c1d297b015
fix 2.8 migration issue (#18389)
The sql must be idempotent

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-03-22 16:12:36 +08:00
Chlins Zhang
6590fe8eef
fix: register sweeper retain counts for purge audit log job (#18390)
Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-22 15:22:24 +08:00
Peter Jakubis
284d58453c
Change storage_service.redirect.disabled in harbor.yml.tmpl to storage_service.redirect.deactivate (#14615)
* set to disable

Signed-off-by: Peter Jakubis <balonik32@gmail.com>

* move pr-14615 prepare migration version from 2.7.0 to 2.8.0

Signed-off-by: yminer <yminer@vmware.com>

---------

Signed-off-by: Peter Jakubis <balonik32@gmail.com>
Signed-off-by: yminer <yminer@vmware.com>
Co-authored-by: Peter Jakubis <peter.jakubis@piano.io>
Co-authored-by: Vadim Bauer <vb@container-registry.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
Co-authored-by: yminer <yminer@vmware.com>
2023-03-22 13:55:22 +08:00
Wang Yan
2f380495bf
revert subject id in the accessory (#18377)
DO not replact id with digest and just add digest into the accessory table

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-03-22 10:58:30 +08:00
stonezdj(Daojun Zhang)
46fa91f866
Fix dangling state execution (#18272)
Add max update hour and max dangling hour setting in config.yaml
  Fixes #17611

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-03-21 18:48:14 +08:00
Chlins Zhang
67d3f9add8
feat: support configurate the http client timeout for webhook job (#18382)
Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-21 11:54:10 +08:00
Chlins Zhang
f21b1481bb
refactor: refactor the old goroutine execution sweep (#18361)
refactor: refactor the old goroutine execution sweep to global execution sweep job

1. Delete the old goroutine execution sweeper when create execution.(in the case of high concurrency can cause goroutine backlogs, affect the performance of core)
2. Introduce the new way to sweep executions, a global scheduled job will take the work.

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-21 10:10:55 +08:00
Shijun Sun
2b3f178a50
Upgrade Golang packages (#18376)
1. Upgrade golang.org/x/net to 0.7.0
2. Upgrade helm.sh/helm/v3 to 3.11.1

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-20 15:59:37 +08:00
dependabot[bot]
79c0a22ce8
Bump webpack from 5.74.0 to 5.76.0 in /src/portal/app-swagger-ui (#18352)
Bumps [webpack](https://github.com/webpack/webpack) from 5.74.0 to 5.76.0.
- [Release notes](https://github.com/webpack/webpack/releases)
- [Commits](https://github.com/webpack/webpack/compare/v5.74.0...v5.76.0)

---
updated-dependencies:
- dependency-name: webpack
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-20 15:06:00 +08:00
Wang Yan
bb291aaa16
add middleware for artifact with subject (#18369)
As for the distribution spec 1.1, it supports client to push an manifest with subject field. By leverging this fidle, harbor could build up the linkage between the subject artifact and it's accessories.

Signed-off-by: wang yan <wangyan@vmware.com>
2023-03-19 20:09:41 +08:00
Chlins Zhang
ff01efc777
fix: fix the webhook migration sql (#18374)
Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-19 10:27:06 +08:00
Chlins Zhang
14df2b2b60
feat: support configrate the jobservice logger sweeper duration (#18365)
Support configurate the jobservice logger sweeper duration from
harbor.yml.

Closes: #10958

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-18 10:46:40 +08:00
dependabot[bot]
5a71b01a68
Bump mheap/github-action-required-labels from 2 to 3 (#18039)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Orlix <OrlinVasilev@users.noreply.github.com>
2023-03-17 15:13:08 +02:00
Shijun Sun
e086710173
Fix some UI issues (#18371)
1. Fixes #17892
2. Redirect to default page when redirectUrl starts with /account/sign-in

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-17 18:52:23 +08:00
Daniel Jiang
bea8dece07
feat: upgrade golang to 1.20.1 (#18370)
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
2023-03-17 17:49:44 +08:00
Wilfred Almeida
6774717185
docs: Updated Web UI URL in CONTRIBUTING.md (#18362)
Co-authored-by: Orlix <OrlinVasilev@users.noreply.github.com>
@wy65701436 it will not run the checks as we excluded the checks if only md files are changed will merge it now
2023-03-17 10:02:17 +02:00
Shijun Sun
339f5b106b
Make label filter editable for replication rule (#18357)
1. Fixes #15825
2. Now, you can input labels or select them from the candidates

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-17 15:48:03 +08:00
MinerYang
e76aff6a0a
add external redis username config to support redis6 ACL (#18364)
add external redis username o support redis6 ACL

Signed-off-by: yminer <yminer@vmware.com>
2023-03-17 14:16:19 +08:00
Shijun Sun
53d86f872e
Support accessory recursion for artifact list (#18366)
1. Update accessory UI to support recursion

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-17 13:01:24 +08:00
Shijun Sun
321d8a0885
Update UI packages (#18312)
1. Update Angular packages to 15.2.1
2. Update swagger-ui to 4.17.1
3. Update Clarity to 15.0.1 and remove datepickerToggle property

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-17 12:14:16 +08:00
Orlix
4f8225cc13
Remove release-note/update label from dependabot for github-actions (#18103) 2023-03-16 14:29:58 +02:00
Chlins Zhang
2148ee9fbe
migration: add sql to migrate the old webhook job to new way (#18342)
Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-16 16:27:43 +08:00
Thomas Coudert
5287c0e79d
Improve Portal french translation (#18289)
* Remove useless translation values and fix variable name typo

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>

* Improve Portal French translation

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>

* Translate Portal CVE_EXPORT in french

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>
2023-03-15 14:25:14 +08:00
Back Yu
fe236ecd2e
Support vpc and internal network (goharbor#17488) (#17489)
Signed-off-by: Back Yu <yhfszb@gmail.com>
2023-03-15 11:04:45 +08:00
Yang Jiao
26ce10221e
Add Job Service Dashboard Job Queues testcase (#18347)
Fix #17949

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-03-14 17:09:19 +08:00
Shijun Sun
1acba0c3bb
Add dynamic column support (#18331)
1. Fixes #17815
2. Add dynamic column support for replication rule list  and artifact list

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-14 14:41:16 +08:00
Shijun Sun
a1d397842d
Improve webhook UI (#18325)
1. Add text format for payload data
2. Delete payload_format for Slack

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-14 13:28:12 +08:00
Chlins Zhang
65e675d2e6
feat: integrate CloudEvents to webhook (#18322)
Integrate CloudEvents as payload format for webhook.

Closes: #17748

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-14 10:44:25 +08:00
Nageshbansal
125daf9cdb
Fixes Publish to Github Packages (#18180)
1. Creates a publishPackages function in tools/release/release_utils.sh
2. Uses the publishPackages function in publish_release workflow

Fixes issue 18138

Signed-off-by: Nagesh Bansal <nageshbansal59@gmail.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
2023-03-13 17:26:31 +08:00
Wang Yan
9b61d34c4c
add referrers api (#18324)
add referrers api

The define of referrers api in the upstream oci spec: https://github.com/opencontainers/distribution-spec/blob/v1.1.0-rc1/spec.md#listing-referrers

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-03-12 15:28:37 +08:00
stonezdj(Daojun Zhang)
ab636fe3da
Remove go routine to reloadSetting (#18318)
Config is cached in redis
  Fixes #18189

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-03-11 15:45:50 +08:00
Shengwen YU
4efee54f07
feat: upgrade mockery version (#18332)
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
2023-03-11 08:16:11 +08:00
Shijun Sun
ec7c99c270
Add agent config for ng serve (#18323)
1. Add agent setting for the proxy config
2. Add https-proxy-agent package

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-10 17:22:11 +08:00
Yang Jiao
1e38565aae
Migrate robot account and notification policy related to Chartmuseum (#18316)
Migrate robot permission and notification policy related to Chartmuseum

Update robot permission and notification policy as Harbor v2.8.0 deprecates chartmuseum.
Harbor deprecates chartmuseum as of v2.8.0
Epic: goharbor#17958
Discussion: goharbor#15057

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-03-10 12:19:11 +08:00
stonezdj(Daojun Zhang)
e8e56fd31d
Check tag name for OCI spec (#18311)
Verify tag name with OCI spec when creating tag

  Fixes #18073

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-03-10 10:40:37 +08:00
stonezdj(Daojun Zhang)
5c9ce836cf
Skip robot account for oidc_cli middleware (#18317)
Fixes #15253

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-03-09 15:41:08 +08:00
Wang Yan
5a065d1cd8
fix robot account list project (#18304)
Fixes #17636, to determine permissions for the project resource, the path should be /project instead of /project/project.

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-03-09 14:16:18 +08:00
Wang Yan
295260b7a3
replace subject id with digest (#18278)
Since it has to support push subject and accessories in either order, it has to replace digest with id

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-03-08 17:03:12 +08:00
Yang Jiao
fecee37439
Update robot account to skip NotFoundErr (#18321)
Fix #18320

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-03-08 15:39:50 +08:00
hyeyoung-leee
2c287cf27a
Modified to check the expiration time of the allowlist when determining the vulnerability of an artifact (#18106)
Signed-off-by: hyeyoung-lee <hyeyoung.lee@nhn.com>
2023-03-08 11:25:40 +08:00
Shijun Sun
1238384428
Add logs column for worker datagrid (#18307)
1. Related back-end PR #18261

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-07 19:58:39 +08:00
Shijun Sun
38d7eda1ad
Update UI for the deprecation of Artifact Hub (#18303)
1. Update edit-registry page to enable the edition for Artifact Hub
2. Update edit-replication-rule page to enable the edition for rules contain Artifact Hub

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-07 18:12:08 +08:00
Shijun Sun
ba9078f463
Enhance webhook UI (#18291)
1. Add execution list for a certain webhook policy
  2. Add task list for a certain execution

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-07 17:12:18 +08:00
stonezdj(Daojun Zhang)
5c0266e719
Get job log by job_id in worker (#18261)
Get job by job_id in redis

  Get the last 10MB of data if it exceeds 10MB

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-03-06 13:19:10 +08:00
Shijun Sun
6f01d7480b
Add retry times for calling CVE data export execution list API (#18297)
1.Fixes #17879
2.Add retry times to avoid endless API calls for CVE data export execution list API

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-03 14:44:36 +08:00
Chlins Zhang
90db04e92d
refactor: refact the webhook API and life process (#18255)
refactor: refact the notification job API and life process

1. Introduce new APIs for webhook jobs management.
2. Refact legacy APIs for backforward compatible.
3. Migrate the webhook jobs process to unified execution/task framework.

Closes: #18210

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-03 10:17:47 +08:00
Yang Jiao
1f3f732bd6
Update the replication rule related to the Chartmuseum (#18274)
Update the registry and replication rule related to the Chartmuseum

Update replication_policy and registry as Harbor v2.8.0 deprecates chartmuseum.
Harbor deprecates chartmuseum as of v2.8.0
Epic: #17958
Discussion: #15057

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-03-02 17:28:27 +08:00
stonezdj(Daojun Zhang)
320c64e433
Sort user and usergroup by most match order (#18273)
fixes #17859

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-03-01 10:11:21 +08:00
Shijun Sun
9973d99f3e
Remove chart api (#18265)
* remove chart api from swagger

Delete the api path for chart in the swagger

Signed-off-by: Wang Yan <wangyan@vmware.com>

* Remove chart APIs
   1. Remove some chart-related steps for Dockerfile for portal  container
   2. Remove chart APIs for API center

Signed-off-by: AllForNothing <sshijun@vmware.com>

---------

Signed-off-by: Wang Yan <wangyan@vmware.com>
Signed-off-by: AllForNothing <sshijun@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
2023-02-24 14:47:42 +08:00
Yang Jiao
660e1d1362
Remove chartmuseum test case (#18267)
Harbor deprecates chartmuseum as of v2.8.0
Epic: #17958
Discussion: #15057

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-02-24 10:56:28 +08:00