Upstream/harbor
1
0
Fork 0
mirror of https://github.com/goharbor/harbor.git synced 2024-07-01 09:15:08 +02:00
Code Issues Projects Releases Wiki Activity
12,093 Commits 46 Branches 304 Tags 361 MiB
c88abed3ef
Commit Graph

5918 Commits

Author SHA1 Message Date
stonezdj(Daojun Zhang)
da949bfc3f
Delete project member when delete project (#19523) 
Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-11-08 20:51:21 +08:00
Shijun Sun
bfd44b9115
Update UI package to clear security alerts (#19553) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-11-08 15:30:08 +08:00
stonezdj(Daojun Zhang)
c9214256e5
Skip to validate username when update user profile (#19552) 
fixes #19528

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-11-08 13:29:30 +08:00
Daniel Jiang
3f7c605cf5
[WIP] Remove vendor folder from harbor code base (#19508) 
* Remove vendor folder from harbor code base

Signed-off-by: Daniel Jiang <jiangd@vmware.com>

* debug ut failure

* debug failure

* debug failure

---------

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2023-11-05 14:37:25 +08:00
Shijun Sun
d0a9754786
Update the style for severity (#19525) 
1.Related issue #19249

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-11-02 09:02:32 +00:00
stonezdj(Daojun Zhang)
b337f51e7e
Replace comma in username to avoid casbin issue (#19505) 
Check username when creating user by API
   Replace comma with underscore in username for OnboardUser
   Fixes #19356

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-11-02 03:50:50 +00:00
Shijun Sun
f75a2f9407
Add a tooltip for the replication rule (#19509) 
1. Fixes #19371

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-10-31 10:32:00 +00:00
MinerYang
193b00b9e6
bump golang to 1.21.3 (#19504) 
update ut mock

update go mod

Signed-off-by: yminer <yminer@vmware.com>
 2023-10-31 15:01:23 +08:00
Shijun Sun
064a109f56
Not allow comma for the user name (#19501) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-10-30 16:02:52 +01:00
SphinxKnight
d3907f6eee
fix: Accessibility - change color for WCAG AA (#19472) 
* fix: Accessibility - change color for WCAG AA

Signed-off-by: julieng <julien.gattelier@gmail.com>

* fix: #ffffff to #fff to comply with stylelint

Signed-off-by: julieng <julien.gattelier@gmail.com>

* Factoring in #19249

Signed-off-by: julieng <julien.gattelier@gmail.com>

---------

Signed-off-by: julieng <julien.gattelier@gmail.com>
 2023-10-25 03:44:54 +00:00
MinerYang
adb066cf50
bump go.opentelemetry.io/contrib/instrumentation/github.com/gorilla/m… (#19477) 
bump go.opentelemetry.io/contrib/instrumentation/github.com/gorilla/mux/otelmux

Signed-off-by: yminer <yminer@vmware.com>
 2023-10-24 08:21:34 +00:00
stonezdj(Daojun Zhang)
7b0beed934
Delete tag retention rule and tag immutable rule when deleting project (#19390) 
fixes #18250

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-10-24 04:28:16 +00:00
Kenji Gaillac
a1effcbb98
Add label's description as tooltip (#19421) 
* feat(ui): add label's description as tooltip

Will only display the tooltip on artifact-list-page.

Signed-off-by: Kenji Gaillac <kenji@gaillac.eu>

* fix(ui): remove redundant condition

Signed-off-by: Kenji Gaillac <kenji@gaillac.eu>

---------

Signed-off-by: Kenji Gaillac <kenji@gaillac.eu>
 2023-10-24 01:52:35 +00:00
Chlins Zhang
99b40bf764
feat: enhance the replication webhook payload (#19433) 
Add the new filed 'references' to the replication webhook payload, which
can help user better know the replicated artifact tags or digests.
(references is the lists of the artifact tag name or digest if no tag)

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-10-23 03:29:30 +00:00
imeoer
13f4fca96e
subject: fix missing media type recognition for nydus (#19453) 
Nydus images are compatible with both docker scheme v2 and OCI image spec v1
types of config media type:

  - application/vnd.oci.image.config.v1+json
  - application/vnd.docker.container.image.v1+json

The patch fixes the media type recognition on the accessory type check.

Signed-off-by: Yan Song <yansong.ys@antgroup.com>
Co-authored-by: MinerYang <yminer@vmware.com>
 2023-10-19 10:53:13 +08:00
stonezdj(Daojun Zhang)
d030ab216b
Use batch to list the job id in the job queue to avoid crash redis (#19444) 
fixes: #19436

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-10-18 09:31:37 +00:00
MinerYang
84a85fb299
bump golang.org/x/net to v0.17.0 && go.opentelemetry.io/contrib (#19461) 
bump golang.org/x/net to v0.17.0

Signed-off-by: yminer <yminer@vmware.com>

bump go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp  to v0.45.0
 2023-10-18 14:34:51 +08:00
Shijun Sun
18b979576d
Update the style for operation-component (#19445) 
1.Fixes #19399

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-10-17 09:29:23 +08:00
Wang Yan
f9ab185ed0
fix issue 19392 (#19437) 
Needs to set the repo when to handle the accessory before subject manifest.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-10-12 15:15:42 +08:00
stonezdj(Daojun Zhang)
663d0b81a7
Change fixed_version to package_version in query dangerous CVE sql (#19397) 
Change fixed_version to package_version
  fixes #19391

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-10-11 07:57:19 +00:00
Kenji Gaillac
27e70cdf4f
feat(i18n): update french translations (#19418) 
Signed-off-by: Kenji Gaillac <kenji@gaillac.eu>
 2023-10-10 09:29:06 +00:00
Shijun Sun
d0322dfcba
Hide version property if the value is undefined (#19395) 
1.Related issue #19391

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-09-28 10:59:10 +08:00
Wang Yan
3338f27189
support accessory in either order (#19375) 
In certain cases, the OCI client may push the subject artifact and accessory in either order.
Therefore, it is necessary to handle situations where the client pushes the accessory ahead of the subject artifact.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-09-23 02:42:58 +08:00
MinerYang
6fd4a2bd37
update default processor for unknwon type config (#19372) 
update OCI-Subject header

Signed-off-by: yminer <yminer@vmware.com>

update default processor & add ut for artifact icon

update ut coverage
 2023-09-21 15:19:42 +08:00
Wang Yan
4051b2b302
fix user resource (#19366) 
fix the user resrouce defination of user api

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-09-18 14:16:25 +08:00
Bin Liu
26a4f6eeea
Remove duplicated sort fields from order by clause (#19347) 
In MustClone() it will set Sorts field twice, that will
generate two duplicated order by fields in the generated SQL.

Signed-off-by: bin liu <liubin0329@gmail.com>
 2023-09-17 02:01:30 +08:00
Wang Yan
ed370a496b
deprecate resource label (#19349) 
There is no api is using the DAO, remove it from the source code.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-09-14 01:25:52 +08:00
Shijun Sun
12ce91594f
Upgrade UI packages (#19330) 
1.Upgrade Angular packages to 16.2.1
2.Upgrade cypress to 13.1.0

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-09-12 16:50:29 +08:00
rongfu.leng
d55823d888
remove chart-museum related to logic (#18722) 
Signed-off-by: lengrongfu <1275177125@qq.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-09-11 15:15:02 +08:00
stonezdj(Daojun Zhang)
7f191630e4
Remove job status track information from redis after stop (#19227) 
Remove job status track information from redis after stop the job in the queue

  After stop in the queue:
  Remove key in {harbor_job_service_namespace}:job_track:inprogress
  Remove {harbor_job_service_namespace}:job_stats:<job_id>
  fixes #19211

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-09-05 10:30:48 +08:00
Shijun Sun
e2d088987c
Switch to a new chart library (#19262) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-09-01 16:46:43 +08:00
Bin Liu
0e039b255c
exporter: add field alias for count(*) func (#18840) 
Add an alias so that orm can parse the column name regardless of
the type and version of the database.

Signed-off-by: bin liu <liubin0329@gmail.com>
 2023-08-30 09:05:44 +08:00
Bin Liu
7ed1920d66
Delete unused code (#19061) 
func GetRedisOfRegURL is not referenced.

Signed-off-by: bin liu <liubin0329@gmail.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-08-29 19:23:20 +08:00
rongfu.leng
f3e4216124
change JOB_ID to Task_ID (#19127) 
Signed-off-by: lengrongfu <1275177125@qq.com>
 2023-08-25 15:49:56 +08:00
MinerYang
06139c1396
change Referrers Content-Type to application/vnd.oci.image.index.v1+json (#19212) 
Signed-off-by: yminer <yminer@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-08-25 11:54:55 +08:00
Shijun Sun
dd90313c72
Add a tooltip for the page title of security hub (#19231) 
1. This tooltip explains the artifacts total count

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-24 18:21:39 +08:00
Bin Liu
23fd87a316
i18n: fix typo for CONFIRM_SECRET (#19140) 
Signed-off-by: bin liu <liubin0329@gmail.com>
 2023-08-24 14:52:52 +08:00
stonezdj(Daojun Zhang)
298ecbbe7d
Refine total artifact and scanned artifact (#19228) 
Artifact include all accessory, child artifact
  fixes #19215

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-08-22 16:03:33 +08:00
Shijun Sun
444404f7f4
Add new uri path to ShouldNotReuseRoute array (#19217) 
1.Fixes #19216

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-21 18:54:44 +08:00
Wang Yan
927e7f92a2
fix gc dry run issue (#19208) 
In the dry run mode, the accessories should be considered when try to simulate delete the subject manifest.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-08-21 13:28:07 +08:00
Chlins Zhang
c7e25295fe
fix: support customize cache db for business (#19182) 
Support to configure the customized redis db for cache layer and other
misc business for core, by default the behavior is same with
previous(stored in db 0).

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-08-18 11:04:16 +08:00
stonezdj(Daojun Zhang)
83ff2b277a
Wrong artifact scanned count (#19198) 
fixes #19197

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-08-17 14:12:07 +08:00
Chlins Zhang
52e66155d4
log: change log level to reduce the noise logs (#19146) 
1. Change some logs level to reduce the noise.
2. Wrap the go-redis.Nil error as ErrNotFound to avoid confusing

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-08-17 11:11:04 +08:00
stonezdj(Daojun Zhang)
d98699b5fc
Filter artifact without CVE from top 5 dangerous artifacts (#19187) 
Fixes #19186

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-08-17 09:29:23 +08:00
Shijun Sun
0e9fe03e54
Update the max length for the filters (#19194) 
1.Fixes #19193

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-16 17:14:34 +08:00
Peter Dave Hello
289d4e27cc
Update zh-tw (Traditional Chinese) locale (#19161) 
Update zh-tw (Traditional Chinese) locale, follow up of #18608

Signed-off-by: Peter Dave Hello <hsu@peterdavehello.org>
 2023-08-16 09:57:52 +08:00
Shijun Sun
296e905940
ignore spaces for vulnerability filters (#19180) 
1.Fixes #19168

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-15 11:41:50 +08:00
Shengwen YU
88c6018950
fix: cron string validation (#19071) 
fix: cron string validation (the 1st field of a cron string must be 0 when there are 6 fields)

Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-08-09 10:22:54 +08:00
Shengwen YU
90de9092ce
fix: add storage_limit check (#19095) 
fix: add storage_limit check (add ValidateQuotaLimit as a general method to validate quota limit value)

Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-08-09 09:37:07 +08:00
Shijun Sun
958bed2ee0
Update ui to fix some issues (#19101) 
1. Add digest filter for vulnerability search, for #19023
2. Fixes #19104

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-07 14:49:50 +08:00
Chlins Zhang
a036e4a7b0
fix: skip to delete scan reports if the digest still referenced (#19110) 
fix: skip to delete scan reports if the digest still referenced by other artifacts

Avoid to delete the scan reports in case the artifact deleted but still
referenced by the other artifacts.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-08-07 14:00:26 +08:00
stonezdj(Daojun Zhang)
0e92eaea18
Sort most dangerous vulnerabilities by score and severity level (#19103) 
Check it is referred by a scan_report
  Add index to report_vulnerability_record to improve performance
  Fixes #19014 #19028

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-08-07 10:13:34 +08:00
stonezdj(Daojun Zhang)
c62ec7daac
Add artifact digest to query condition (#19102) 
Fixes #19023

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-08-07 09:24:44 +08:00
stonezdj(Daojun Zhang)
3de778e9f1
Fix incorrect artifact and scanned artifact count issue (#19106) 
* Fix incorrect artifact and scanned artifact count issue

  fixes #19009 #19020 #19013

Signed-off-by: stonezdj <daojunz@vmware.com>

* fix issue

Signed-off-by: stonezdj <daojunz@vmware.com>

---------

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-08-07 08:40:26 +08:00
Shijun Sun
f8cf772d86
Update style for add-replication-rule page (#19100) 
1. Fixes #19098

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-04 14:12:15 +08:00
Chlins Zhang
8c23bcdc54
fix: fix replication list projects with pure numberic name (#19090) 
Quote the project name when listing projects in the replication, resolve
the issue of pure number name of project.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-08-04 09:29:51 +08:00
Shijun Sun
530b78285b
Convert the string "0" to number 0 (#19080) 
1. Fixes #19046

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-03 21:52:49 +08:00
Shijun Sun
d34775296c
Update cron ui for add replicatipn rule page (#19083) 
1.Fixes #19072

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-03 18:18:54 +08:00
Shijun Sun
26b53ef343
Show banner message on log in page (#19078) 
1. Fixes #19076

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-03 17:24:09 +08:00
Shijun Sun
1d81b3d8ad
Update ui for gc history and banner message (#19094) 
1. Fixes #19031
2. Fixes #19049

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-03 14:36:20 +08:00
Shijun Sun
cdd3f267b5
Merge cosign check and notation check (#19079) 
1.Merge cosign check and notaion check into one API call, related issue #19077

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-03 13:06:15 +08:00
Shijun Sun
39ec1e4b1f
Add validator for duration of banner message (#19057) 
1.Fixes #19049

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-01 18:31:32 +08:00
Shijun Sun
b496edf304
Update style for banner message ui (#19069) 
1.Fixes #19021
2.Fixes #19022

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-01 17:24:28 +08:00
Shijun Sun
28e6a99eb9
Remove cache for project policy updating (#19068) 
1. Fixes #19065

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-01 15:31:32 +08:00
Shijun Sun
854e0295d1
Update security hub ui (#19062) 
1. Fixes #19010
2. Fixes #19011
3. Fixes #19012
4. Fixes #19015
5. Fixes #19025
6. Fixes #19026
7. Fixes #19034
8. Fixes #19037

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-31 20:25:05 +08:00
Wang Yan
d93f24a4dc
fix dry run creation time (#19060) 
fixes #19059
Give the mock time for dry run, otherwise, it will be zero.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-31 17:29:56 +08:00
Wang Yan
bef4ccc782
fixes 19043 (#19054) 
fixes #19043
Skip the policy checking when to pull the notation signature

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-31 15:11:21 +08:00
Wang Yan
638c26c41a
add details for gc dry-run (#19050) 
* add details for gc dry-run

fixes 19040
Gives the make details for the dry-run

Signed-off-by: wang yan <wangyan@vmware.com>

* Update details column for gc history (#164)

1.Fixes #19038

Signed-off-by: AllForNothing <sshijun@vmware.com>

---------

Signed-off-by: wang yan <wangyan@vmware.com>
Signed-off-by: AllForNothing <sshijun@vmware.com>
Co-authored-by: Shijun Sun <30999793+AllForNothing@users.noreply.github.com>
 2023-07-31 13:53:51 +08:00
Wang Yan
ae33dbd801
fix accessory import issue (#19053) 
fixes #19041

The issuse was introduced by https://github.com/goharbor/harbor/pull/17087.
To move the import to main since the anonymous imports only allowed at main in go-cilint.

Fixes it:
To add the anonymous imports at the jobservice main since the gc job needs to remove accessory when to delete an artifact

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-30 22:36:03 +08:00
Wang Yan
db82d6e082
fix signer name (#19001) 
Append the signer name to the error message which will be returned by the client

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-25 21:30:32 +08:00
stonezdj(Daojun Zhang)
d92aca9d39
Fix wrong scanned artifact count when there are multiple report for an artifact (#18975) 
Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-07-25 14:10:10 +08:00
Chlins Zhang
8ff095d68f
feat: add the configuration for quota update provider (#18928) 
Add the related configurations for the quota update provider to the
harbor.yml.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-07-24 16:28:19 +08:00
Chlins Zhang
c030fd7863
refactor: replace the gc redigo client to the standard cache (#18965) 
Refactor the clean redis logic in the GC job, replace the redigo client
to the lib cache interface which can simplify operations.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-07-24 14:30:25 +08:00
Chlins Zhang
94c76002a2
refactor: remove duplicated artifact deletion handler (#18959) 
Remove the duplicated artifact deletion event handler and enhance the
internal artifact onDelete method.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-07-24 13:38:39 +08:00
Shijun Sun
b380b7869b
Update the parameter to search cosign (#18963) 
1.Fixes #18960

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-21 01:07:22 +08:00
Shengwen YU
9091661539
fix: replication policy cron setting - the 1st field must be 0; the Minutes field cannot be * (#18923) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-07-20 17:55:48 +08:00
Wang Yan
ce893635aa
support nydus as a accessory (#18953) 
Recognize nydus image(with subject) as a kind of accessory and built the releationship with subject manifest

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-20 15:54:23 +08:00
Shijun Sun
73533d8f4f
Add Security Hub UI (#18942) 
1.Fixes #18819
2.Add Security Hub page as a new tab for Interrogation Services

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-20 10:54:07 +08:00
Shijun Sun
b08dce4805
Update the regex for policy name and the tooltip message (#18947) 
1. Fixes task 6 for #18091

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-19 20:04:12 +08:00
Shijun Sun
79e8c396bf
Add Notation UI for deployment security (#18952) 
1. for #18927

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-19 18:22:11 +08:00
Chlins Zhang
970bdab936
fix: correct the operator in the webhook payload (#18906) 
Fix the incorrect or meaningless operator in the webhook payload.

Fixes: #18438

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-07-19 15:40:29 +08:00
stonezdj(Daojun Zhang)
d4aa9b13c4
Add vulnerability search API (#18924) 
use q.Query to pass all query conditions

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-07-19 10:17:14 +08:00
stonezdj(Daojun Zhang)
82ee5295ea
Log warning message when current user is freeze (#18937) 
Signed-off-by: stonezdj <daojunz@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-07-18 15:34:28 +08:00
Wang Yan
d745ad9175
fix gc schedule issue (#18934) 
fixes #18881

Save workers settings into the metadata of the garbage collection schedule

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-17 15:28:21 +08:00
Wang Yan
ff2b99d711
enable notary v2 policy checker (#18927) 
add notary v2 pull policy, when it enables, the artifact cannot be pull without the notation signature.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-14 13:35:56 +08:00
Wang Yan
5cce621471
add notation support (#18909) 
Accept and recognize the signature of notation client

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-13 11:18:34 +08:00
Kane
06c4c1c076
update icons (#18767) 
Signed-off-by: vndroid <diracsvip@gmail.com>
Co-authored-by: Vadim Bauer <vb@container-registry.com>
 2023-07-12 17:35:14 +03:00
stonezdj(Daojun Zhang)
93e428d0d2
Add security hub summary API (#18872) 
include WithCVE, WithArtifact option

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-07-12 19:18:08 +08:00
Shengwen YU
df4dc3c00b
fix: add password/secret length check to be <= 128 (#18916) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-07-12 17:04:50 +08:00
Chlins Zhang
98f592f94f
chore: upgrade golang-migrate to v4.16.2 (#18879) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-07-11 10:21:12 +08:00
Chlins Zhang
78799ccb2f
perf: introduce update quota by redis (#18871) 
Introduce the quota update provider, improve the performance of pushing
artifacts to same project with high concurrency by implementing
optimistic lock in redis. By default the function is disabled, open it
by set env 'QUOTA_UPDATE_PROVIDER=Redis' for the core container.

Fixes: #18440

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-07-10 13:24:37 +08:00
Bin Liu
c8120d5712
API: update ScannerRegistration.properties.url format (#18799) 
The format of ScannerRegistration.properties.url should be
`uri` but not `url`.

Fixes: #18798

Signed-off-by: bin liu <liubin0329@gmail.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-07-05 17:57:06 +08:00
Shijun Sun
1efe944a8d
Correct the hidden property for clrDgHideableColumn (#18890) 
1.Fixes #18870

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-05 14:31:35 +08:00
Wang Yan
dbaae9e64e
support OCI-Subject header (#18885) 
fixes #18865
the response header OCI-Subject to indicate to the client that the registry processed the request's subject.

Signed-off-by: wang yan <wangyan@vmware.com>
Co-authored-by: System Administrator <root@wangyanCQFQY.vmware.com>
 2023-07-05 11:25:19 +08:00
Shijun Sun
1d2624eefc
Add worker parameter for GC (#18882) 
1. Related back-end PR #18855

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-04 10:36:39 +08:00
Shijun Sun
ef96c729c0
Add costomized banner message UI (#18827) 
1.Fixes #18719
2.Add Banner Message item to configuration
3.Add banner_message property to systeminfo API

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-03 15:58:37 +08:00
Shijun Sun
8fe561865d
Add unit test for hidden columns (#18873) 
1. Fixes #18870

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-03 10:58:14 +08:00
stonezdj(Daojun Zhang)
d84b1d07d2
Update table scan_report and extract cvss_v3_score from vendor attribute (#18854) 
For better performance when query cve information, add summary information to scan_report
    Extract cve_score from vendor attribute in vulnerability_record
    SQL migrate script for the update

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-06-29 17:30:50 +08:00
Wang Yan
7435c8c5ab
add multiple deletion of GC (#18855) 
User can specify the workers when to issue an GC execution, the maxium count of workers is 5.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-06-29 16:22:18 +08:00
Chlins Zhang
02a1c417d4
refactor: migrate the redis command keys to scan (#18825) 
Refine the cache interface, migrate the Keys to Scan, change the redis
underlying keys command to scan.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-06-29 11:28:19 +08:00
Shijun Sun
d36ca805b4
Add new client Podman to the pull command (#18857) 
1.Fixes #18832

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-27 11:12:41 +08:00
Bin Liu
1d6c02f52d
jobservice: update readme (#18849) 
To reflect the newest job interface, and the missing parts of
DB job service logger.

Signed-off-by: bin liu <liubin0329@gmail.com>
 2023-06-27 09:13:47 +08:00
Bin Liu
4035f438fb
jobservice: add DB to job logger config (#18821) 
jobservice: add DB to job logger config in readme

Job logger support file, db and stdout, the comment should
include the type of DB as well as file and stdout.

Signed-off-by: bin liu <liubin0329@gmail.com>
 2023-06-19 14:19:21 +08:00
Shijun Sun
b822952537
Update the text for the oidc cli secret tooltip (#18814) 
Update the text for oidc cli secret tooltip
1. Update the text for all the i18n files

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-16 12:29:58 +08:00
Shijun Sun
ca94a23a74
Add Podman push command to the UI (#18810) 
1. Fixes #18781

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-13 10:45:05 +08:00
Shijun Sun
fc9c68a6fc
Add Details column for gc history (#18797) 
1. Related #18779
2. Show how many blobs and manifest have been deleted and how much space has been freed up

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-12 15:41:50 +08:00
Chlins Zhang
c08c7c52a0
fix: optimize the mechanism of quota refresh (#18795) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-06-08 14:19:06 +08:00
rongfu.leng
8251fd2dec
【UT】add unit test for collector system info (#18717) 
add unit test for system collector test

Signed-off-by: lengrongfu <1275177125@qq.com>
 2023-06-08 10:06:09 +08:00
Shijun Sun
2f51daf707
Add a tooltip for slack notification (#18787) 
1.Fixes #18507
2.Remind the users of Slack's rate limits

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-07 16:14:36 +08:00
rongfu.leng
8fe578e7ab
feat: Optimize quota checking when pushing images (#17392) 
Signed-off-by: lengrongfu <1275177125@qq.com>
 2023-06-05 17:19:55 +08:00
Chlins Zhang
fbeeaa7537
fix: add checkpoint when enqueue scan tasks for scan all (#18680) 
Fix the scanAll cannot be stopped in case of large number of artifacts,
add the checkpoint before submit scan tasks, mark the scanAll stopped
flag in the redis.

Fixes: #18044

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-06-05 15:12:54 +08:00
Wang Yan
680c78d368
add more details in gc history (#18779) 
Show more infors in the gc history, like the sweep size and how many blobs and manifests were removed by GC.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-06-02 17:33:09 +08:00
Chlins Zhang
a98711c0fc
fix: clean up scan executions and reports after deleting artifact (#18693) 
Cleanup the associated resources(scan executions and scan reports) after
deletion of artifact.

Fixes: #18634

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-05-31 14:54:52 +08:00
cui fliter
e19ec9623b
Fix: fix function name in comments (#18726) 
fix function name in comments

Signed-off-by: cui fliter <imcusg@gmail.com>
 2023-05-31 10:26:19 +08:00
orblazer
b021dbd2d6
fix invalid access action (#18188) 
Signed-off-by: orblazer <orblazer.minecraft@gmail.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-05-30 17:49:01 +08:00
Wang Yan
5c42bc10ec
remove the legacy migration (#18754) 
Delete the legacy migration and artifact abstration code for v2.0

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-05-30 15:17:24 +08:00
guangwu
b7b0e43a21
fix: import optimization (#18727) 
Signed-off-by: guoguangwu <guoguangwu@magic-shield.com>
 2023-05-30 13:24:08 +08:00
lishaokai1995
04833d2daf
Fix syntax errors in comments (#18746) 
Signed-off-by: lishaokai1995 <lishaokai1995@126.com>
 2023-05-29 17:31:08 +08:00
rongfu.leng
4652d752b6
【optimization】Use URL.Redacted method repleace redacted (#18716) 
use URL.Redacted method replease redacted

Signed-off-by: lengrongfu <1275177125@qq.com>
 2023-05-29 16:37:51 +08:00
stonezdj(Daojun Zhang)
1b1af4a14c
Return error when proxy cache get too many request error(429) (#18728) 
Add 429 too many request error in http error
  Fixes #18707

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2023-05-29 13:33:46 +08:00
Shijun Sun
11d6bb4437
Add a text to explain the time window for GC (#18735) 
1.Fixes #18692

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-05-26 18:32:19 +02:00
Wang Yan
06aa87a72a
set tag pull time for proxy cache (#18731) 
fixes #18708

to set the pull time of tag for the first time cache the artifact.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-05-26 13:08:37 +08:00
Shijun Sun
c399e5ee4a
Improve repo_read_only header on the UI (#18729) 
1. Fixes #18694
2. Now non-system-admin users can also see the repo_read_only header

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-05-24 17:13:33 +08:00
Shijun Sun
43c6586af4
Upgrade Angular and Clarity to the latest version (#18709) 
1.Upgrade Angular to 16.0.2
2.Upgrade Clarity to 15.4.0

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-05-23 15:59:31 +08:00
stonezdj(Daojun Zhang)
9d042ad585
Use subtle.ConstantTimeCompare instead of compare directly (#18697) 
Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-05-22 16:16:52 +08:00
Aklis
6a79de761b
Fix the channel that never receives a value (#18139) 
fix the channel that never receives a value
fix the code with the linter's recommendation by https://github.com/goharbor/harbor/blob/main/CONTRIBUTING.md#develop-build-and-test

Signed-off-by: iAklis <chenpinwei@gmail.com>
 2023-05-19 09:17:46 +08:00
Wang Yan
bf7c82b9a8
remove the notary from backend (#18668) 
Since harbor deprecates notary since v2.9.0, this pull request targets to remove the code related with notary.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-05-18 18:47:42 +08:00
Shengwen YU
845bcdb184
fix: add retry on the caller of v2DeleteManifest instead within v2DeleteManifest (#18662) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-05-18 09:35:33 +08:00
MinerYang
954f1f3d06
bump up github.com/distribution/distribution v2.8.2 (#18687) 
Signed-off-by: yminer <yminer@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-05-17 11:58:43 +08:00
Viktor
f8e28dbede
Changed logic search projects in gitlab adapter (#18529) 
* fix(gitlab): change logic search projects usage search_namespaces

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>

* tests(gitlab): remove old data and actualization test

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>

* refactor(gitlab): added debug log

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>
(cherry picked from commit 732806221b1c1633682fe1adad4cbcd3a4687d0b)

* lint(gitlab): fix import order

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>

---------

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>
 2023-05-15 13:59:13 +08:00
Eng Zer Jun
18a33c2b40
chore: replace github.com/ghodss/yaml with sigs.k8s.io/yaml (#18606) 
At the time of making this commit, the package `github.com/ghodss/yaml`
is no longer actively maintained.

`sigs.k8s.io/yaml` is a permanent fork of `ghodss/yaml` and is actively
maintained by Kubernetes SIG.

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
Co-authored-by: MinerYang <yminer@vmware.com>
 2023-05-12 18:21:26 +08:00
Shijun Sun
f2fc0f6a99
Remove notary UI (#18666) 
1. Remove notary from the UI
2. Remove notary-related unit test cases

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-05-11 19:23:51 +08:00
Chlins Zhang
36c2b93fe6
fix: sweep executions of image scan job (#18649) 
1. Change the SCAN_ALL job execution retain counts from 5 to 1(per
   current design, only one report be stored for every artifact, so
   retain latest 1 is enough).
2. Enable the sweep for IMAGE_SCAN job(retain latest 1).

Fixes: #18633

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-05-10 13:23:54 +08:00
Peter Dave Hello
0e3e70bc7a
Improve zh-tw (Traditional Chinese) locale (#18608) 
Improve zh-tw locale

Signed-off-by: Peter Dave Hello <hsu@peterdavehello.org>
 2023-05-08 10:55:04 +08:00
Chlins Zhang
362387f914
fix: improve the performance of list artifacts (#18610) 
1. Change the query for listing tasks of scan which can use the db
   index.
2. Add the gin index for task.extra_attrs.report_uuids

Fixes: #18013

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-30 09:10:28 +08:00
Shijun Sun
1bbe8c57e7
Fix message prompt under the header (#18613) 
1.Fixes #18601

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-27 18:03:05 +08:00
MoonStrider
bf6389e6c8
fix: error log use wrong variable err (#18602) 
Update manager.go

Signed-off-by: MoonStrider <37744291+dyf991645@users.noreply.github.com>
 2023-04-26 21:10:41 +08:00
MinerYang
ebac530b46
add goheader linter settings (#18503) 
fix files for goheader linter

fix copyright 2018/2019

Signed-off-by: yminer <yminer@vmware.com>
 2023-04-25 11:18:42 +08:00
Shijun Sun
dd973b1593
Add missing i18n key-value for helm chart (#18578) 
1.Fixes #18572

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-23 15:03:04 +08:00
Shijun Sun
e793e2433d
Update position to vertical-align for copy button (#18563) 
Fixes #17906

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-20 15:40:24 +08:00
MinerYang
8df99a5116
bump golang.org/x/net && helm.sh/helm/v3 on main (#18545) 
bump golang.org/x/net v0.9.0 on main

Signed-off-by: yminer <yminer@vmware.com>

bump helm.sh/helm/v3 v3.11.3
 2023-04-18 19:18:04 +08:00
pgillich
eec5342490
feat: log with trace ID (#18181) 
feat: log trace ID

Implements #18029

If the Trace ID is sent to the Harbor in HTTP header or the tracing
is enabled (and the Trace ID is generated), the Trace ID will be
added to the log lines as a new field.

Signed-off-by: Peter Gillich <pgillich@gmail.com>
 2023-04-17 15:03:00 +08:00
Shijun Sun
de6e517136
Upgrade harbor-portal to v2.9.0 (#18525) 
1.Magrate protractor to cypress as protractor has been deprecated

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-13 18:52:06 +08:00
Chlins Zhang
d3d6e29aa3
fix: update stopped execution status immediately instead of async update (#18527) 
Update the stopped execution status immediately becasue the user
experience is not good if wait long time when stop or reschedule a job.

Fixes: #18526

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-13 17:52:41 +08:00
Iceber Gu
3afa525f0b
Change the permissions of the *.go file from 0755 to 0644 (#17919) 
Signed-off-by: Iceber Gu <wei.cai-nat@daocloud.io>
 2023-04-13 09:07:36 +02:00
Danny Kulchinsky
14e4c07d94
GC: correctly handle manifest unknown (404) condition in v2DeleteManifest retry loop (#18386) 
GC: handle manifest unknown (404) during V2 manifest delete retry loop

Signed-off-by: Danny Kulchinsky <dkulchinsky@fastly.com>
 2023-04-12 22:52:52 +02:00
Shijun Sun
b201f9864f
Synchronize text modification of quota tooltip to all the i18n files (#18518) 2023-04-12 10:55:02 +03:00
Chlins Zhang
b755c43d12
fix: clean the redis if the execution is not found (#18517) 
Delete the execution outdated status key in the redis when the execution
is not found.

Fixes: #18511

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-12 14:17:42 +08:00
Orlix
7edb447e14
Reword quota definitions based on user input (#18512) 
Fixes: https://github.com/goharbor/harbor/issues/17545

Signed-off-by: OrlinVasilev <ovasilev@vmware.com>
 2023-04-12 11:50:33 +08:00
Chlins Zhang
5791f0c979
fix: fix error bitsize of jobservice reaper scan locks (#18487) 
Change the bitSize from 16 to 64 in the jobservice reaper, the 16 is too
small when the redis cursor over the max value of int16.

Fixes: #18486

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-07 10:59:30 +08:00
Chlins Zhang
697f1c79ef
fix: fix the regexp of execution status outdate key (#18481) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-05 13:53:45 +08:00
Chlins Zhang
62bb56daf6
refactor: refresh the execution status in async mode (#18434) 
Refactor the logic for updating the status of execution when receiving
the hook from jobservice, avoid the optimistic lock due to the multiple
tasks update one execution by refreshing the status asynchronously. But
still retain the old way by specifying the flag from ENV.

Fixes: #17584

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-04 16:37:37 +08:00
Wang Yan
60d9664cbc
fix accessory replication issue (#18471) 
Fixes #18404
Support multiple level accessories replication.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-04-04 12:46:46 +08:00
Chlins Zhang
a7cef5e24f
fix: wrap schedule/exec/task creation as orm tx (#18458) 
Wrap orm tx when the scheduler try to create the task because submit job
maybe failure depends on the jobservice.

Fixes: #18452

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-04 08:42:18 +08:00
Chlins Zhang
02c51c6b70
fix: correct the retention webhook payload (#18462) 
Fix the incorrect number of total and retained in the retention webhook
payload, and completes the deleted_artifacts field.

Fixes: #18428

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-03 17:51:02 +08:00
Shijun Sun
1499faf67d
Update styles for UI according to the designer's suggestions (#18463) 
1. extend the width for event type label
2. add quotes for Retain image last pull time to make it more understandable

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-03 16:47:21 +08:00
Chlins Zhang
ca9e2d2f07
fix: generate uuid as CloudEvents id and add additional requestid (#18451) 
1. Change the the value of CloudEvents id from requestid to uuid
2. Add additional requestid to trace to event

Fixes: #18448

Signed-off-by: chlins <chenyuzh@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-04-03 12:02:19 +08:00
Wang Yan
fddfaa7ba5
fix copy artifact issue (#18460) 
To enable the middleware to save the project_blob data, make sure to set the accessories options to true when handling the artifact copy.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-04-03 10:58:17 +08:00
Chlins Zhang
cb0749c7ab
fix: add default payload_format for http type webhook (#18445) 
1. Add migration SQL to handle the lost payload format for old policies.
2. Set payload format to 'Default' if not specified for http webhook in the API handler.
3. Fix the migration sql of notification_job

Fixes: #18401, #18453

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-02 15:33:33 +08:00
Chlins Zhang
5d953b48b6
fix: escape the event data for slack webhook payload (#18424) 
Escape the event data of slack webhook as original payload is invalid
when send to slack.

Fixes: #18423

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-31 17:05:10 +08:00
Shijun Sun
95972ba693
Add new app level warning message (#18449) 
1. Show a app level warning if there is a stuck job
2. Chang `Replication finished` to `Replication status changed`

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-31 13:08:57 +08:00
Wang Yan
f63865d207
fix the copy artifact issue (#18441) 
support copy artifact with multipe levels of accessories.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-03-30 02:04:22 +08:00
Shijun Sun
d22c94b4fa
Remove markdown pipe for webhook payload data (#18439) 
1. Fixes #18435

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-29 12:38:32 +08:00
Chlins Zhang
6e9f72315f
fix: fix the invalid jobid for scan data export (#18398) 
Change the JobId param type from int to string, use int will bring some
problems for encode/decode type mismatch which generate the invalid
repository name.

Fixes: #18380

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-29 10:29:08 +08:00
Shijun Sun
9e0e8e066b
Add copy digest button for accessories (#18433) 
1.Fixes #18406

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-28 20:37:44 +08:00
Shijun Sun
9b593550ab
Upgrade @clr/angular and @clr/ui to 15.0.3 (#18427) 
1.Fixes #18422
2. Upgrade Clarity to 15.0.3 to apply the fix for #18422

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-28 19:38:12 +08:00
Shijun Sun
e5e61d4eaa
Correct a grammatical error (#18431) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-28 18:05:22 +08:00
Wang Yan
1bb3914de4
fix referrers api response issue (#18430) 
1, add fitler artifactType to header when the api is called with filter
2, give an empty json body on non aritfact scenario
3, give an empty array on non accessory scenario
4, fix the artifact type filter issue

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-28 13:51:37 +08:00
stonezdj(Daojun Zhang)
088d18bccf
Fix sql error in FixDanglingStateExecution (#18411) 
Fix sql error in fixDanglingStateExecution

  fixes #18408

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-28 12:57:02 +08:00
Wang Yan
deaecf2de5
add subject artifact repo (#18394) 
add suject_artifact_repo column in the table artifact_accessory

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-22 21:48:09 +08:00
Chlins Zhang
395ae77d64
fix: change the default max retry count for webhook job to 3 (#18392) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-22 17:36:50 +08:00
Chlins Zhang
6590fe8eef
fix: register sweeper retain counts for purge audit log job (#18390) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-22 15:22:24 +08:00
Wang Yan
2f380495bf
revert subject id in the accessory (#18377) 
DO not replact id with digest and just add digest into the accessory table

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-22 10:58:30 +08:00
stonezdj(Daojun Zhang)
46fa91f866
Fix dangling state execution (#18272) 
Add max update hour and max dangling hour setting in config.yaml
  Fixes #17611

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-21 18:48:14 +08:00
Chlins Zhang
67d3f9add8
feat: support configurate the http client timeout for webhook job (#18382) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-21 11:54:10 +08:00
Chlins Zhang
f21b1481bb
refactor: refactor the old goroutine execution sweep (#18361) 
refactor: refactor the old goroutine execution sweep to global execution sweep job

1. Delete the old goroutine execution sweeper when create execution.(in the case of high concurrency can cause goroutine backlogs, affect the performance of core)
2. Introduce the new way to sweep executions, a global scheduled job will take the work.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-21 10:10:55 +08:00
Shijun Sun
2b3f178a50
Upgrade Golang packages (#18376) 
1. Upgrade golang.org/x/net to 0.7.0
2. Upgrade helm.sh/helm/v3 to 3.11.1

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-20 15:59:37 +08:00
dependabot[bot]
79c0a22ce8
Bump webpack from 5.74.0 to 5.76.0 in /src/portal/app-swagger-ui (#18352) 
Bumps [webpack](https://github.com/webpack/webpack) from 5.74.0 to 5.76.0.
- [Release notes](https://github.com/webpack/webpack/releases)
- [Commits](https://github.com/webpack/webpack/compare/v5.74.0...v5.76.0)

---
updated-dependencies:
- dependency-name: webpack
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-03-20 15:06:00 +08:00
Wang Yan
bb291aaa16
add middleware for artifact with subject (#18369) 
As for the distribution spec 1.1, it supports client to push an manifest with subject field. By leverging this fidle, harbor could build up the linkage between the subject artifact and it's accessories.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-03-19 20:09:41 +08:00
Shijun Sun
e086710173
Fix some UI issues (#18371) 
1. Fixes #17892
2. Redirect to default page when redirectUrl starts with /account/sign-in

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-17 18:52:23 +08:00
Daniel Jiang
bea8dece07
feat: upgrade golang to 1.20.1 (#18370) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-03-17 17:49:44 +08:00
Shijun Sun
339f5b106b
Make label filter editable for replication rule (#18357) 
1. Fixes #15825
2. Now, you can input labels or select them from the candidates

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-17 15:48:03 +08:00
MinerYang
e76aff6a0a
add external redis username config to support redis6 ACL (#18364) 
add external redis username o support redis6 ACL

Signed-off-by: yminer <yminer@vmware.com>
 2023-03-17 14:16:19 +08:00
Shijun Sun
53d86f872e
Support accessory recursion for artifact list (#18366) 
1. Update accessory UI to support recursion

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-17 13:01:24 +08:00
Shijun Sun
321d8a0885
Update UI packages (#18312) 
1. Update Angular packages to 15.2.1
2. Update swagger-ui to 4.17.1
3. Update Clarity to 15.0.1 and remove datepickerToggle property

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-17 12:14:16 +08:00
Thomas Coudert
5287c0e79d
Improve Portal french translation (#18289) 
* Remove useless translation values and fix variable name typo

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>

* Improve Portal French translation

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>

* Translate Portal CVE_EXPORT in french

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>
 2023-03-15 14:25:14 +08:00
Back Yu
fe236ecd2e
Support vpc and internal network (goharbor#17488) (#17489) 
Signed-off-by: Back Yu <yhfszb@gmail.com>
 2023-03-15 11:04:45 +08:00
Shijun Sun
1acba0c3bb
Add dynamic column support (#18331) 
1. Fixes #17815
2. Add dynamic column support for replication rule list  and artifact list

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-14 14:41:16 +08:00
Shijun Sun
a1d397842d
Improve webhook UI (#18325) 
1. Add text format for payload data
2. Delete payload_format for Slack

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-14 13:28:12 +08:00
Chlins Zhang
65e675d2e6
feat: integrate CloudEvents to webhook (#18322) 
Integrate CloudEvents as payload format for webhook.

Closes: #17748

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-14 10:44:25 +08:00
Wang Yan
9b61d34c4c
add referrers api (#18324) 
add referrers api

The define of referrers api in the upstream oci spec: https://github.com/opencontainers/distribution-spec/blob/v1.1.0-rc1/spec.md#listing-referrers

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-12 15:28:37 +08:00
stonezdj(Daojun Zhang)
ab636fe3da
Remove go routine to reloadSetting (#18318) 
Config is cached in redis
  Fixes #18189

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-11 15:45:50 +08:00
Shengwen YU
4efee54f07
feat: upgrade mockery version (#18332) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-03-11 08:16:11 +08:00
Shijun Sun
ec7c99c270
Add agent config for ng serve (#18323) 
1. Add agent setting for the proxy config
2. Add https-proxy-agent package

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-10 17:22:11 +08:00
stonezdj(Daojun Zhang)
e8e56fd31d
Check tag name for OCI spec (#18311) 
Verify tag name with OCI spec when creating tag

  Fixes #18073

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-10 10:40:37 +08:00
stonezdj(Daojun Zhang)
5c9ce836cf
Skip robot account for oidc_cli middleware (#18317) 
Fixes #15253

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-09 15:41:08 +08:00
Wang Yan
5a065d1cd8
fix robot account list project (#18304) 
Fixes #17636, to determine permissions for the project resource, the path should be /project instead of /project/project.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-09 14:16:18 +08:00
Wang Yan
295260b7a3
replace subject id with digest (#18278) 
Since it has to support push subject and accessories in either order, it has to replace digest with id

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-08 17:03:12 +08:00
Yang Jiao
fecee37439
Update robot account to skip NotFoundErr (#18321) 
Fix #18320

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
 2023-03-08 15:39:50 +08:00
hyeyoung-leee
2c287cf27a
Modified to check the expiration time of the allowlist when determining the vulnerability of an artifact (#18106) 
Signed-off-by: hyeyoung-lee <hyeyoung.lee@nhn.com>
 2023-03-08 11:25:40 +08:00