Commit Graph

11593 Commits

Author SHA1 Message Date
Chlins Zhang f21b1481bb
refactor: refactor the old goroutine execution sweep (#18361)
refactor: refactor the old goroutine execution sweep to global execution sweep job

1. Delete the old goroutine execution sweeper when create execution.(in the case of high concurrency can cause goroutine backlogs, affect the performance of core)
2. Introduce the new way to sweep executions, a global scheduled job will take the work.

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-21 10:10:55 +08:00
Shijun Sun 2b3f178a50
Upgrade Golang packages (#18376)
1. Upgrade golang.org/x/net to 0.7.0
2. Upgrade helm.sh/helm/v3 to 3.11.1

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-20 15:59:37 +08:00
dependabot[bot] 79c0a22ce8
Bump webpack from 5.74.0 to 5.76.0 in /src/portal/app-swagger-ui (#18352)
Bumps [webpack](https://github.com/webpack/webpack) from 5.74.0 to 5.76.0.
- [Release notes](https://github.com/webpack/webpack/releases)
- [Commits](https://github.com/webpack/webpack/compare/v5.74.0...v5.76.0)

---
updated-dependencies:
- dependency-name: webpack
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-20 15:06:00 +08:00
Wang Yan bb291aaa16
add middleware for artifact with subject (#18369)
As for the distribution spec 1.1, it supports client to push an manifest with subject field. By leverging this fidle, harbor could build up the linkage between the subject artifact and it's accessories.

Signed-off-by: wang yan <wangyan@vmware.com>
2023-03-19 20:09:41 +08:00
Chlins Zhang ff01efc777
fix: fix the webhook migration sql (#18374)
Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-19 10:27:06 +08:00
Chlins Zhang 14df2b2b60
feat: support configrate the jobservice logger sweeper duration (#18365)
Support configurate the jobservice logger sweeper duration from
harbor.yml.

Closes: #10958

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-18 10:46:40 +08:00
dependabot[bot] 5a71b01a68
Bump mheap/github-action-required-labels from 2 to 3 (#18039)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Orlix <OrlinVasilev@users.noreply.github.com>
2023-03-17 15:13:08 +02:00
Shijun Sun e086710173
Fix some UI issues (#18371)
1. Fixes #17892
2. Redirect to default page when redirectUrl starts with /account/sign-in

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-17 18:52:23 +08:00
Daniel Jiang bea8dece07
feat: upgrade golang to 1.20.1 (#18370)
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
2023-03-17 17:49:44 +08:00
Wilfred Almeida 6774717185
docs: Updated Web UI URL in CONTRIBUTING.md (#18362)
Co-authored-by: Orlix <OrlinVasilev@users.noreply.github.com>
@wy65701436 it will not run the checks as we excluded the checks if only md files are changed will merge it now
2023-03-17 10:02:17 +02:00
Shijun Sun 339f5b106b
Make label filter editable for replication rule (#18357)
1. Fixes #15825
2. Now, you can input labels or select them from the candidates

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-17 15:48:03 +08:00
MinerYang e76aff6a0a
add external redis username config to support redis6 ACL (#18364)
add external redis username o support redis6 ACL

Signed-off-by: yminer <yminer@vmware.com>
2023-03-17 14:16:19 +08:00
Shijun Sun 53d86f872e
Support accessory recursion for artifact list (#18366)
1. Update accessory UI to support recursion

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-17 13:01:24 +08:00
Shijun Sun 321d8a0885
Update UI packages (#18312)
1. Update Angular packages to 15.2.1
2. Update swagger-ui to 4.17.1
3. Update Clarity to 15.0.1 and remove datepickerToggle property

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-17 12:14:16 +08:00
Orlix 4f8225cc13
Remove release-note/update label from dependabot for github-actions (#18103) 2023-03-16 14:29:58 +02:00
Chlins Zhang 2148ee9fbe
migration: add sql to migrate the old webhook job to new way (#18342)
Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-16 16:27:43 +08:00
Thomas Coudert 5287c0e79d
Improve Portal french translation (#18289)
* Remove useless translation values and fix variable name typo

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>

* Improve Portal French translation

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>

* Translate Portal CVE_EXPORT in french

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>
2023-03-15 14:25:14 +08:00
Back Yu fe236ecd2e
Support vpc and internal network (goharbor#17488) (#17489)
Signed-off-by: Back Yu <yhfszb@gmail.com>
2023-03-15 11:04:45 +08:00
Yang Jiao 26ce10221e
Add Job Service Dashboard Job Queues testcase (#18347)
Fix #17949

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-03-14 17:09:19 +08:00
Shijun Sun 1acba0c3bb
Add dynamic column support (#18331)
1. Fixes #17815
2. Add dynamic column support for replication rule list  and artifact list

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-14 14:41:16 +08:00
Shijun Sun a1d397842d
Improve webhook UI (#18325)
1. Add text format for payload data
2. Delete payload_format for Slack

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-14 13:28:12 +08:00
Chlins Zhang 65e675d2e6
feat: integrate CloudEvents to webhook (#18322)
Integrate CloudEvents as payload format for webhook.

Closes: #17748

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-14 10:44:25 +08:00
Nageshbansal 125daf9cdb
Fixes Publish to Github Packages (#18180)
1. Creates a publishPackages function in tools/release/release_utils.sh
2. Uses the publishPackages function in publish_release workflow

Fixes issue 18138

Signed-off-by: Nagesh Bansal <nageshbansal59@gmail.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
2023-03-13 17:26:31 +08:00
Wang Yan 9b61d34c4c
add referrers api (#18324)
add referrers api

The define of referrers api in the upstream oci spec: https://github.com/opencontainers/distribution-spec/blob/v1.1.0-rc1/spec.md#listing-referrers

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-03-12 15:28:37 +08:00
stonezdj(Daojun Zhang) ab636fe3da
Remove go routine to reloadSetting (#18318)
Config is cached in redis
  Fixes #18189

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-03-11 15:45:50 +08:00
Shengwen YU 4efee54f07
feat: upgrade mockery version (#18332)
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
2023-03-11 08:16:11 +08:00
Shijun Sun ec7c99c270
Add agent config for ng serve (#18323)
1. Add agent setting for the proxy config
2. Add https-proxy-agent package

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-10 17:22:11 +08:00
Yang Jiao 1e38565aae
Migrate robot account and notification policy related to Chartmuseum (#18316)
Migrate robot permission and notification policy related to Chartmuseum

Update robot permission and notification policy as Harbor v2.8.0 deprecates chartmuseum.
Harbor deprecates chartmuseum as of v2.8.0
Epic: goharbor#17958
Discussion: goharbor#15057

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-03-10 12:19:11 +08:00
stonezdj(Daojun Zhang) e8e56fd31d
Check tag name for OCI spec (#18311)
Verify tag name with OCI spec when creating tag

  Fixes #18073

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-03-10 10:40:37 +08:00
stonezdj(Daojun Zhang) 5c9ce836cf
Skip robot account for oidc_cli middleware (#18317)
Fixes #15253

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-03-09 15:41:08 +08:00
Wang Yan 5a065d1cd8
fix robot account list project (#18304)
Fixes #17636, to determine permissions for the project resource, the path should be /project instead of /project/project.

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-03-09 14:16:18 +08:00
Wang Yan 295260b7a3
replace subject id with digest (#18278)
Since it has to support push subject and accessories in either order, it has to replace digest with id

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-03-08 17:03:12 +08:00
Yang Jiao fecee37439
Update robot account to skip NotFoundErr (#18321)
Fix #18320

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-03-08 15:39:50 +08:00
hyeyoung-leee 2c287cf27a
Modified to check the expiration time of the allowlist when determining the vulnerability of an artifact (#18106)
Signed-off-by: hyeyoung-lee <hyeyoung.lee@nhn.com>
2023-03-08 11:25:40 +08:00
Shijun Sun 1238384428
Add logs column for worker datagrid (#18307)
1. Related back-end PR #18261

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-07 19:58:39 +08:00
Shijun Sun 38d7eda1ad
Update UI for the deprecation of Artifact Hub (#18303)
1. Update edit-registry page to enable the edition for Artifact Hub
2. Update edit-replication-rule page to enable the edition for rules contain Artifact Hub

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-07 18:12:08 +08:00
Shijun Sun ba9078f463
Enhance webhook UI (#18291)
1. Add execution list for a certain webhook policy
  2. Add task list for a certain execution

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-07 17:12:18 +08:00
stonezdj(Daojun Zhang) 5c0266e719
Get job log by job_id in worker (#18261)
Get job by job_id in redis

  Get the last 10MB of data if it exceeds 10MB

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-03-06 13:19:10 +08:00
Shijun Sun 6f01d7480b
Add retry times for calling CVE data export execution list API (#18297)
1.Fixes #17879
2.Add retry times to avoid endless API calls for CVE data export execution list API

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-03 14:44:36 +08:00
Chlins Zhang 90db04e92d
refactor: refact the webhook API and life process (#18255)
refactor: refact the notification job API and life process

1. Introduce new APIs for webhook jobs management.
2. Refact legacy APIs for backforward compatible.
3. Migrate the webhook jobs process to unified execution/task framework.

Closes: #18210

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-03 10:17:47 +08:00
Yang Jiao 1f3f732bd6
Update the replication rule related to the Chartmuseum (#18274)
Update the registry and replication rule related to the Chartmuseum

Update replication_policy and registry as Harbor v2.8.0 deprecates chartmuseum.
Harbor deprecates chartmuseum as of v2.8.0
Epic: #17958
Discussion: #15057

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-03-02 17:28:27 +08:00
stonezdj(Daojun Zhang) 320c64e433
Sort user and usergroup by most match order (#18273)
fixes #17859

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-03-01 10:11:21 +08:00
Shijun Sun 9973d99f3e
Remove chart api (#18265)
* remove chart api from swagger

Delete the api path for chart in the swagger

Signed-off-by: Wang Yan <wangyan@vmware.com>

* Remove chart APIs
   1. Remove some chart-related steps for Dockerfile for portal  container
   2. Remove chart APIs for API center

Signed-off-by: AllForNothing <sshijun@vmware.com>

---------

Signed-off-by: Wang Yan <wangyan@vmware.com>
Signed-off-by: AllForNothing <sshijun@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
2023-02-24 14:47:42 +08:00
Yang Jiao 660e1d1362
Remove chartmuseum test case (#18267)
Harbor deprecates chartmuseum as of v2.8.0
Epic: #17958
Discussion: #15057

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-02-24 10:56:28 +08:00
Niko Wenselowski 10c54c0d82
Improve swagger descriptions (without changing security settings) (#18205)
* Improve swagger definitions.

References #15624
2023-02-23 12:57:50 +01:00
Shijun Sun a79c0ad496
Add next scheduled time for tag retention (#18223)
1. Add next scheduled time UI
   2. Update font style

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-02-22 12:26:58 +08:00
Shijun Sun c5640acd7b
Add scanner_skip_update_pulltime property for system setting (#18214)
1. Related backend PR #17807

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-02-22 10:58:01 +08:00
Chlins Zhang 4141d77407
fix: remove noise log when core started (#18260)
Fixes: #18126

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-02-21 17:38:42 +08:00
dependabot[bot] 99b37117e1
Bump actions/stale from 6.0.1 to 7.0.0 (#18018)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-20 16:42:04 +02:00
Yang Jiao f4f80ca8fb
Update DB Dockerfile.base (#18249)
1. Update the path to postgresql.conf.sample as it has changed in postgresql 13.10
2. Remove creating symbolic link as it already exists in postgresql 13.10

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-02-20 17:20:53 +08:00