Commit Graph

11631 Commits

Author SHA1 Message Date
Chlins Zhang
5791f0c979
fix: fix error bitsize of jobservice reaper scan locks (#18487)
Change the bitSize from 16 to 64 in the jobservice reaper, the 16 is too
small when the redis cursor over the max value of int16.

Fixes: #18486

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-04-07 10:59:30 +08:00
dependabot[bot]
499940a8a7
Bump mheap/github-action-required-labels from 3 to 4 (#18472)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Orlix <7236111+OrlinVasilev@users.noreply.github.com>
2023-04-06 12:01:18 +03:00
Chlins Zhang
697f1c79ef
fix: fix the regexp of execution status outdate key (#18481)
Signed-off-by: chlins <chenyuzh@vmware.com>
2023-04-05 13:53:45 +08:00
Chlins Zhang
72a6ef2514
style: adjust the style of migration SQL (#18475)
Signed-off-by: chlins <chenyuzh@vmware.com>
2023-04-04 17:37:27 +08:00
Chlins Zhang
62bb56daf6
refactor: refresh the execution status in async mode (#18434)
Refactor the logic for updating the status of execution when receiving
the hook from jobservice, avoid the optimistic lock due to the multiple
tasks update one execution by refreshing the status asynchronously. But
still retain the old way by specifying the flag from ENV.

Fixes: #17584

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-04-04 16:37:37 +08:00
Shengwen YU
1e884c58c2
feat: update TRIVYVERSION=v0.38.2 & TRIVYADAPTERVERSION=v0.30.9 (#18473)
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
2023-04-04 15:25:17 +08:00
Wang Yan
60d9664cbc
fix accessory replication issue (#18471)
Fixes #18404
Support multiple level accessories replication.

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-04-04 12:46:46 +08:00
MinerYang
de20659da5
bump golang 1.20.2 (#18469)
Signed-off-by: yminer <yminer@vmware.com>
2023-04-04 10:59:16 +08:00
Chlins Zhang
a7cef5e24f
fix: wrap schedule/exec/task creation as orm tx (#18458)
Wrap orm tx when the scheduler try to create the task because submit job
maybe failure depends on the jobservice.

Fixes: #18452

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-04-04 08:42:18 +08:00
Chlins Zhang
02c51c6b70
fix: correct the retention webhook payload (#18462)
Fix the incorrect number of total and retained in the retention webhook
payload, and completes the deleted_artifacts field.

Fixes: #18428

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-04-03 17:51:02 +08:00
Shijun Sun
1499faf67d
Update styles for UI according to the designer's suggestions (#18463)
1. extend the width for event type label
2. add quotes for Retain image last pull time to make it more understandable

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-04-03 16:47:21 +08:00
Yang Jiao
f5be644d35
Update UI test cases (#18470)
1. Update replication role testcase
2. Update job service dashboard testcase

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-04-03 16:01:51 +08:00
Chlins Zhang
ca9e2d2f07
fix: generate uuid as CloudEvents id and add additional requestid (#18451)
1. Change the the value of CloudEvents id from requestid to uuid
2. Add additional requestid to trace to event

Fixes: #18448

Signed-off-by: chlins <chenyuzh@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
2023-04-03 12:02:19 +08:00
Wang Yan
fddfaa7ba5
fix copy artifact issue (#18460)
To enable the middleware to save the project_blob data, make sure to set the accessories options to true when handling the artifact copy.

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-04-03 10:58:17 +08:00
Chlins Zhang
cb0749c7ab
fix: add default payload_format for http type webhook (#18445)
1. Add migration SQL to handle the lost payload format for old policies.
2. Set payload format to 'Default' if not specified for http webhook in the API handler.
3. Fix the migration sql of notification_job

Fixes: #18401, #18453

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-04-02 15:33:33 +08:00
Chlins Zhang
5d953b48b6
fix: escape the event data for slack webhook payload (#18424)
Escape the event data of slack webhook as original payload is invalid
when send to slack.

Fixes: #18423

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-31 17:05:10 +08:00
Shijun Sun
95972ba693
Add new app level warning message (#18449)
1. Show a app level warning if there is a stuck job
2. Chang `Replication finished` to `Replication status changed`

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-31 13:08:57 +08:00
Yang Jiao
a95808c120
Update webhook and repliation element xpath (#18456)
Update webhook xpath
Update replication xpath

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-03-31 11:00:16 +08:00
Wang Yan
f63865d207
fix the copy artifact issue (#18441)
support copy artifact with multipe levels of accessories.

Signed-off-by: wang yan <wangyan@vmware.com>
2023-03-30 02:04:22 +08:00
Shijun Sun
d22c94b4fa
Remove markdown pipe for webhook payload data (#18439)
1. Fixes #18435

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-29 12:38:32 +08:00
Chlins Zhang
6e9f72315f
fix: fix the invalid jobid for scan data export (#18398)
Change the JobId param type from int to string, use int will bring some
problems for encode/decode type mismatch which generate the invalid
repository name.

Fixes: #18380

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-29 10:29:08 +08:00
Shijun Sun
9e0e8e066b
Add copy digest button for accessories (#18433)
1.Fixes #18406

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-28 20:37:44 +08:00
Shijun Sun
9b593550ab
Upgrade @clr/angular and @clr/ui to 15.0.3 (#18427)
1.Fixes #18422
2. Upgrade Clarity to 15.0.3 to apply the fix for #18422

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-28 19:38:12 +08:00
Shijun Sun
e5e61d4eaa
Correct a grammatical error (#18431)
Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-28 18:05:22 +08:00
Shengwen YU
208b7f4cb0
fix: add remove chartmuseum notice message (#18426)
Co-authored-by: Wang Yan <wangyan@vmware.com>
Co-authored-by: Orlix <OrlinVasilev@users.noreply.github.com>
2023-03-28 12:16:17 +03:00
Wang Yan
1bb3914de4
fix referrers api response issue (#18430)
1, add fitler artifactType to header when the api is called with filter
2, give an empty json body on non aritfact scenario
3, give an empty array on non accessory scenario
4, fix the artifact type filter issue

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-03-28 13:51:37 +08:00
stonezdj(Daojun Zhang)
088d18bccf
Fix sql error in FixDanglingStateExecution (#18411)
Fix sql error in fixDanglingStateExecution

  fixes #18408

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-03-28 12:57:02 +08:00
dependabot[bot]
85bcbbaf62
Bump actions/stale from 7.0.0 to 8.0.0 (#18409)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-27 13:00:19 +03:00
Akshat
7da7133bc2
Fix project setup step. (#18271)
Co-authored-by: Vadim Bauer <vb@container-registry.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
Co-authored-by: Orlin Vasilev <ovasilev@vmware.com>
2023-03-24 12:56:51 +02:00
Daniel Jiang
006b588c14
Update the support matrix (#18417) 2023-03-24 12:38:14 +02:00
Wang Yan
deaecf2de5
add subject artifact repo (#18394)
add suject_artifact_repo column in the table artifact_accessory

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-03-22 21:48:09 +08:00
Chlins Zhang
395ae77d64
fix: change the default max retry count for webhook job to 3 (#18392)
Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-22 17:36:50 +08:00
Wang Yan
c1d297b015
fix 2.8 migration issue (#18389)
The sql must be idempotent

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-03-22 16:12:36 +08:00
Chlins Zhang
6590fe8eef
fix: register sweeper retain counts for purge audit log job (#18390)
Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-22 15:22:24 +08:00
Peter Jakubis
284d58453c
Change storage_service.redirect.disabled in harbor.yml.tmpl to storage_service.redirect.deactivate (#14615)
* set to disable

Signed-off-by: Peter Jakubis <balonik32@gmail.com>

* move pr-14615 prepare migration version from 2.7.0 to 2.8.0

Signed-off-by: yminer <yminer@vmware.com>

---------

Signed-off-by: Peter Jakubis <balonik32@gmail.com>
Signed-off-by: yminer <yminer@vmware.com>
Co-authored-by: Peter Jakubis <peter.jakubis@piano.io>
Co-authored-by: Vadim Bauer <vb@container-registry.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
Co-authored-by: yminer <yminer@vmware.com>
2023-03-22 13:55:22 +08:00
Wang Yan
2f380495bf
revert subject id in the accessory (#18377)
DO not replact id with digest and just add digest into the accessory table

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-03-22 10:58:30 +08:00
stonezdj(Daojun Zhang)
46fa91f866
Fix dangling state execution (#18272)
Add max update hour and max dangling hour setting in config.yaml
  Fixes #17611

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-03-21 18:48:14 +08:00
Chlins Zhang
67d3f9add8
feat: support configurate the http client timeout for webhook job (#18382)
Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-21 11:54:10 +08:00
Chlins Zhang
f21b1481bb
refactor: refactor the old goroutine execution sweep (#18361)
refactor: refactor the old goroutine execution sweep to global execution sweep job

1. Delete the old goroutine execution sweeper when create execution.(in the case of high concurrency can cause goroutine backlogs, affect the performance of core)
2. Introduce the new way to sweep executions, a global scheduled job will take the work.

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-21 10:10:55 +08:00
Shijun Sun
2b3f178a50
Upgrade Golang packages (#18376)
1. Upgrade golang.org/x/net to 0.7.0
2. Upgrade helm.sh/helm/v3 to 3.11.1

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-20 15:59:37 +08:00
dependabot[bot]
79c0a22ce8
Bump webpack from 5.74.0 to 5.76.0 in /src/portal/app-swagger-ui (#18352)
Bumps [webpack](https://github.com/webpack/webpack) from 5.74.0 to 5.76.0.
- [Release notes](https://github.com/webpack/webpack/releases)
- [Commits](https://github.com/webpack/webpack/compare/v5.74.0...v5.76.0)

---
updated-dependencies:
- dependency-name: webpack
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-20 15:06:00 +08:00
Wang Yan
bb291aaa16
add middleware for artifact with subject (#18369)
As for the distribution spec 1.1, it supports client to push an manifest with subject field. By leverging this fidle, harbor could build up the linkage between the subject artifact and it's accessories.

Signed-off-by: wang yan <wangyan@vmware.com>
2023-03-19 20:09:41 +08:00
Chlins Zhang
ff01efc777
fix: fix the webhook migration sql (#18374)
Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-19 10:27:06 +08:00
Chlins Zhang
14df2b2b60
feat: support configrate the jobservice logger sweeper duration (#18365)
Support configurate the jobservice logger sweeper duration from
harbor.yml.

Closes: #10958

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-03-18 10:46:40 +08:00
dependabot[bot]
5a71b01a68
Bump mheap/github-action-required-labels from 2 to 3 (#18039)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Orlix <OrlinVasilev@users.noreply.github.com>
2023-03-17 15:13:08 +02:00
Shijun Sun
e086710173
Fix some UI issues (#18371)
1. Fixes #17892
2. Redirect to default page when redirectUrl starts with /account/sign-in

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-17 18:52:23 +08:00
Daniel Jiang
bea8dece07
feat: upgrade golang to 1.20.1 (#18370)
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
2023-03-17 17:49:44 +08:00
Wilfred Almeida
6774717185
docs: Updated Web UI URL in CONTRIBUTING.md (#18362)
Co-authored-by: Orlix <OrlinVasilev@users.noreply.github.com>
@wy65701436 it will not run the checks as we excluded the checks if only md files are changed will merge it now
2023-03-17 10:02:17 +02:00
Shijun Sun
339f5b106b
Make label filter editable for replication rule (#18357)
1. Fixes #15825
2. Now, you can input labels or select them from the candidates

Signed-off-by: AllForNothing <sshijun@vmware.com>
2023-03-17 15:48:03 +08:00
MinerYang
e76aff6a0a
add external redis username config to support redis6 ACL (#18364)
add external redis username o support redis6 ACL

Signed-off-by: yminer <yminer@vmware.com>
2023-03-17 14:16:19 +08:00