Upstream
/
harbor
mirror of https://github.com/goharbor/harbor.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
12,131 Commits 46 Branches 299 Tags 356 MiB
Commit Graph

5953 Commits

Author SHA1 Message Date
stonezdj(Daojun Zhang) d030ab216b
Use batch to list the job id in the job queue to avoid crash redis (#19444) 
fixes: #19436

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-10-18 09:31:37 +00:00
MinerYang 84a85fb299
bump golang.org/x/net to v0.17.0 && go.opentelemetry.io/contrib (#19461) 
bump golang.org/x/net to v0.17.0

Signed-off-by: yminer <yminer@vmware.com>

bump go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp  to v0.45.0
 2023-10-18 14:34:51 +08:00
Shijun Sun 18b979576d
Update the style for operation-component (#19445) 
1.Fixes #19399

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-10-17 09:29:23 +08:00
Wang Yan f9ab185ed0
fix issue 19392 (#19437) 
Needs to set the repo when to handle the accessory before subject manifest.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-10-12 15:15:42 +08:00
stonezdj(Daojun Zhang) 663d0b81a7
Change fixed_version to package_version in query dangerous CVE sql (#19397) 
Change fixed_version to package_version
  fixes #19391

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-10-11 07:57:19 +00:00
Kenji Gaillac 27e70cdf4f
feat(i18n): update french translations (#19418) 
Signed-off-by: Kenji Gaillac <kenji@gaillac.eu>
 2023-10-10 09:29:06 +00:00
Shijun Sun d0322dfcba
Hide version property if the value is undefined (#19395) 
1.Related issue #19391

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-09-28 10:59:10 +08:00
Wang Yan 3338f27189
support accessory in either order (#19375) 
In certain cases, the OCI client may push the subject artifact and accessory in either order.
Therefore, it is necessary to handle situations where the client pushes the accessory ahead of the subject artifact.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-09-23 02:42:58 +08:00
MinerYang 6fd4a2bd37
update default processor for unknwon type config (#19372) 
update OCI-Subject header

Signed-off-by: yminer <yminer@vmware.com>

update default processor & add ut for artifact icon

update ut coverage
 2023-09-21 15:19:42 +08:00
Wang Yan 4051b2b302
fix user resource (#19366) 
fix the user resrouce defination of user api

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-09-18 14:16:25 +08:00
Bin Liu 26a4f6eeea
Remove duplicated sort fields from order by clause (#19347) 
In MustClone() it will set Sorts field twice, that will
generate two duplicated order by fields in the generated SQL.

Signed-off-by: bin liu <liubin0329@gmail.com>
 2023-09-17 02:01:30 +08:00
Wang Yan ed370a496b
deprecate resource label (#19349) 
There is no api is using the DAO, remove it from the source code.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-09-14 01:25:52 +08:00
Shijun Sun 12ce91594f
Upgrade UI packages (#19330) 
1.Upgrade Angular packages to 16.2.1
2.Upgrade cypress to 13.1.0

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-09-12 16:50:29 +08:00
rongfu.leng d55823d888
remove chart-museum related to logic (#18722) 
Signed-off-by: lengrongfu <1275177125@qq.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-09-11 15:15:02 +08:00
stonezdj(Daojun Zhang) 7f191630e4
Remove job status track information from redis after stop (#19227) 
Remove job status track information from redis after stop the job in the queue

  After stop in the queue:
  Remove key in {harbor_job_service_namespace}:job_track:inprogress
  Remove {harbor_job_service_namespace}:job_stats:<job_id>
  fixes #19211

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-09-05 10:30:48 +08:00
Shijun Sun e2d088987c
Switch to a new chart library (#19262) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-09-01 16:46:43 +08:00
Bin Liu 0e039b255c
exporter: add field alias for count(*) func (#18840) 
Add an alias so that orm can parse the column name regardless of
the type and version of the database.

Signed-off-by: bin liu <liubin0329@gmail.com>
 2023-08-30 09:05:44 +08:00
Bin Liu 7ed1920d66
Delete unused code (#19061) 
func GetRedisOfRegURL is not referenced.

Signed-off-by: bin liu <liubin0329@gmail.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-08-29 19:23:20 +08:00
rongfu.leng f3e4216124
change JOB_ID to Task_ID (#19127) 
Signed-off-by: lengrongfu <1275177125@qq.com>
 2023-08-25 15:49:56 +08:00
MinerYang 06139c1396
change Referrers Content-Type to application/vnd.oci.image.index.v1+json (#19212) 
Signed-off-by: yminer <yminer@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-08-25 11:54:55 +08:00
Shijun Sun dd90313c72
Add a tooltip for the page title of security hub (#19231) 
1. This tooltip explains the artifacts total count

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-24 18:21:39 +08:00
Bin Liu 23fd87a316
i18n: fix typo for CONFIRM_SECRET (#19140) 
Signed-off-by: bin liu <liubin0329@gmail.com>
 2023-08-24 14:52:52 +08:00
stonezdj(Daojun Zhang) 298ecbbe7d
Refine total artifact and scanned artifact (#19228) 
Artifact include all accessory, child artifact
  fixes #19215

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-08-22 16:03:33 +08:00
Shijun Sun 444404f7f4
Add new uri path to ShouldNotReuseRoute array (#19217) 
1.Fixes #19216

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-21 18:54:44 +08:00
Wang Yan 927e7f92a2
fix gc dry run issue (#19208) 
In the dry run mode, the accessories should be considered when try to simulate delete the subject manifest.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-08-21 13:28:07 +08:00
Chlins Zhang c7e25295fe
fix: support customize cache db for business (#19182) 
Support to configure the customized redis db for cache layer and other
misc business for core, by default the behavior is same with
previous(stored in db 0).

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-08-18 11:04:16 +08:00
stonezdj(Daojun Zhang) 83ff2b277a
Wrong artifact scanned count (#19198) 
fixes #19197

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-08-17 14:12:07 +08:00
Chlins Zhang 52e66155d4
log: change log level to reduce the noise logs (#19146) 
1. Change some logs level to reduce the noise.
2. Wrap the go-redis.Nil error as ErrNotFound to avoid confusing

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-08-17 11:11:04 +08:00
stonezdj(Daojun Zhang) d98699b5fc
Filter artifact without CVE from top 5 dangerous artifacts (#19187) 
Fixes #19186

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-08-17 09:29:23 +08:00
Shijun Sun 0e9fe03e54
Update the max length for the filters (#19194) 
1.Fixes #19193

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-16 17:14:34 +08:00
Peter Dave Hello 289d4e27cc
Update zh-tw (Traditional Chinese) locale (#19161) 
Update zh-tw (Traditional Chinese) locale, follow up of #18608

Signed-off-by: Peter Dave Hello <hsu@peterdavehello.org>
 2023-08-16 09:57:52 +08:00
Shijun Sun 296e905940
ignore spaces for vulnerability filters (#19180) 
1.Fixes #19168

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-15 11:41:50 +08:00
Shengwen YU 88c6018950
fix: cron string validation (#19071) 
fix: cron string validation (the 1st field of a cron string must be 0 when there are 6 fields)

Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-08-09 10:22:54 +08:00
Shengwen YU 90de9092ce
fix: add storage_limit check (#19095) 
fix: add storage_limit check (add ValidateQuotaLimit as a general method to validate quota limit value)

Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-08-09 09:37:07 +08:00
Shijun Sun 958bed2ee0
Update ui to fix some issues (#19101) 
1. Add digest filter for vulnerability search, for #19023
2. Fixes #19104

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-07 14:49:50 +08:00
Chlins Zhang a036e4a7b0
fix: skip to delete scan reports if the digest still referenced (#19110) 
fix: skip to delete scan reports if the digest still referenced by other artifacts

Avoid to delete the scan reports in case the artifact deleted but still
referenced by the other artifacts.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-08-07 14:00:26 +08:00
stonezdj(Daojun Zhang) 0e92eaea18
Sort most dangerous vulnerabilities by score and severity level (#19103) 
Check it is referred by a scan_report
  Add index to report_vulnerability_record to improve performance
  Fixes #19014 #19028

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-08-07 10:13:34 +08:00
stonezdj(Daojun Zhang) c62ec7daac
Add artifact digest to query condition (#19102) 
Fixes #19023

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-08-07 09:24:44 +08:00
stonezdj(Daojun Zhang) 3de778e9f1
Fix incorrect artifact and scanned artifact count issue (#19106) 
* Fix incorrect artifact and scanned artifact count issue

  fixes #19009 #19020 #19013

Signed-off-by: stonezdj <daojunz@vmware.com>

* fix issue

Signed-off-by: stonezdj <daojunz@vmware.com>

---------

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-08-07 08:40:26 +08:00
Shijun Sun f8cf772d86
Update style for add-replication-rule page (#19100) 
1. Fixes #19098

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-04 14:12:15 +08:00
Chlins Zhang 8c23bcdc54
fix: fix replication list projects with pure numberic name (#19090) 
Quote the project name when listing projects in the replication, resolve
the issue of pure number name of project.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-08-04 09:29:51 +08:00
Shijun Sun 530b78285b
Convert the string "0" to number 0 (#19080) 
1. Fixes #19046

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-03 21:52:49 +08:00
Shijun Sun d34775296c
Update cron ui for add replicatipn rule page (#19083) 
1.Fixes #19072

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-03 18:18:54 +08:00
Shijun Sun 26b53ef343
Show banner message on log in page (#19078) 
1. Fixes #19076

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-03 17:24:09 +08:00
Shijun Sun 1d81b3d8ad
Update ui for gc history and banner message (#19094) 
1. Fixes #19031
2. Fixes #19049

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-03 14:36:20 +08:00
Shijun Sun cdd3f267b5
Merge cosign check and notation check (#19079) 
1.Merge cosign check and notaion check into one API call, related issue #19077

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-03 13:06:15 +08:00
Shijun Sun 39ec1e4b1f
Add validator for duration of banner message (#19057) 
1.Fixes #19049

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-01 18:31:32 +08:00
Shijun Sun b496edf304
Update style for banner message ui (#19069) 
1.Fixes #19021
2.Fixes #19022

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-01 17:24:28 +08:00
Shijun Sun 28e6a99eb9
Remove cache for project policy updating (#19068) 
1. Fixes #19065

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-08-01 15:31:32 +08:00
Shijun Sun 854e0295d1
Update security hub ui (#19062) 
1. Fixes #19010
2. Fixes #19011
3. Fixes #19012
4. Fixes #19015
5. Fixes #19025
6. Fixes #19026
7. Fixes #19034
8. Fixes #19037

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-31 20:25:05 +08:00
Wang Yan d93f24a4dc
fix dry run creation time (#19060) 
fixes #19059
Give the mock time for dry run, otherwise, it will be zero.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-31 17:29:56 +08:00
Wang Yan bef4ccc782
fixes 19043 (#19054) 
fixes #19043
Skip the policy checking when to pull the notation signature

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-31 15:11:21 +08:00
Wang Yan 638c26c41a
add details for gc dry-run (#19050) 
* add details for gc dry-run

fixes 19040
Gives the make details for the dry-run

Signed-off-by: wang yan <wangyan@vmware.com>

* Update details column for gc history (#164)

1.Fixes #19038

Signed-off-by: AllForNothing <sshijun@vmware.com>

---------

Signed-off-by: wang yan <wangyan@vmware.com>
Signed-off-by: AllForNothing <sshijun@vmware.com>
Co-authored-by: Shijun Sun <30999793+AllForNothing@users.noreply.github.com>
 2023-07-31 13:53:51 +08:00
Wang Yan ae33dbd801
fix accessory import issue (#19053) 
fixes #19041

The issuse was introduced by https://github.com/goharbor/harbor/pull/17087.
To move the import to main since the anonymous imports only allowed at main in go-cilint.

Fixes it:
To add the anonymous imports at the jobservice main since the gc job needs to remove accessory when to delete an artifact

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-30 22:36:03 +08:00
Wang Yan db82d6e082
fix signer name (#19001) 
Append the signer name to the error message which will be returned by the client

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-25 21:30:32 +08:00
stonezdj(Daojun Zhang) d92aca9d39
Fix wrong scanned artifact count when there are multiple report for an artifact (#18975) 
Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-07-25 14:10:10 +08:00
Chlins Zhang 8ff095d68f
feat: add the configuration for quota update provider (#18928) 
Add the related configurations for the quota update provider to the
harbor.yml.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-07-24 16:28:19 +08:00
Chlins Zhang c030fd7863
refactor: replace the gc redigo client to the standard cache (#18965) 
Refactor the clean redis logic in the GC job, replace the redigo client
to the lib cache interface which can simplify operations.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-07-24 14:30:25 +08:00
Chlins Zhang 94c76002a2
refactor: remove duplicated artifact deletion handler (#18959) 
Remove the duplicated artifact deletion event handler and enhance the
internal artifact onDelete method.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-07-24 13:38:39 +08:00
Shijun Sun b380b7869b
Update the parameter to search cosign (#18963) 
1.Fixes #18960

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-21 01:07:22 +08:00
Shengwen YU 9091661539
fix: replication policy cron setting - the 1st field must be 0; the Minutes field cannot be * (#18923) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-07-20 17:55:48 +08:00
Wang Yan ce893635aa
support nydus as a accessory (#18953) 
Recognize nydus image(with subject) as a kind of accessory and built the releationship with subject manifest

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-20 15:54:23 +08:00
Shijun Sun 73533d8f4f
Add Security Hub UI (#18942) 
1.Fixes #18819
2.Add Security Hub page as a new tab for Interrogation Services

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-20 10:54:07 +08:00
Shijun Sun b08dce4805
Update the regex for policy name and the tooltip message (#18947) 
1. Fixes task 6 for #18091

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-19 20:04:12 +08:00
Shijun Sun 79e8c396bf
Add Notation UI for deployment security (#18952) 
1. for #18927

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-19 18:22:11 +08:00
Chlins Zhang 970bdab936
fix: correct the operator in the webhook payload (#18906) 
Fix the incorrect or meaningless operator in the webhook payload.

Fixes: #18438

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-07-19 15:40:29 +08:00
stonezdj(Daojun Zhang) d4aa9b13c4
Add vulnerability search API (#18924) 
use q.Query to pass all query conditions

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-07-19 10:17:14 +08:00
stonezdj(Daojun Zhang) 82ee5295ea
Log warning message when current user is freeze (#18937) 
Signed-off-by: stonezdj <daojunz@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-07-18 15:34:28 +08:00
Wang Yan d745ad9175
fix gc schedule issue (#18934) 
fixes #18881

Save workers settings into the metadata of the garbage collection schedule

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-17 15:28:21 +08:00
Wang Yan ff2b99d711
enable notary v2 policy checker (#18927) 
add notary v2 pull policy, when it enables, the artifact cannot be pull without the notation signature.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-14 13:35:56 +08:00
Wang Yan 5cce621471
add notation support (#18909) 
Accept and recognize the signature of notation client

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-07-13 11:18:34 +08:00
Kane 06c4c1c076
update icons (#18767) 
Signed-off-by: vndroid <diracsvip@gmail.com>
Co-authored-by: Vadim Bauer <vb@container-registry.com>
 2023-07-12 17:35:14 +03:00
stonezdj(Daojun Zhang) 93e428d0d2
Add security hub summary API (#18872) 
include WithCVE, WithArtifact option

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-07-12 19:18:08 +08:00
Shengwen YU df4dc3c00b
fix: add password/secret length check to be <= 128 (#18916) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-07-12 17:04:50 +08:00
Chlins Zhang 98f592f94f
chore: upgrade golang-migrate to v4.16.2 (#18879) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-07-11 10:21:12 +08:00
Chlins Zhang 78799ccb2f
perf: introduce update quota by redis (#18871) 
Introduce the quota update provider, improve the performance of pushing
artifacts to same project with high concurrency by implementing
optimistic lock in redis. By default the function is disabled, open it
by set env 'QUOTA_UPDATE_PROVIDER=Redis' for the core container.

Fixes: #18440

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-07-10 13:24:37 +08:00
Bin Liu c8120d5712
API: update ScannerRegistration.properties.url format (#18799) 
The format of ScannerRegistration.properties.url should be
`uri` but not `url`.

Fixes: #18798

Signed-off-by: bin liu <liubin0329@gmail.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-07-05 17:57:06 +08:00
Shijun Sun 1efe944a8d
Correct the hidden property for clrDgHideableColumn (#18890) 
1.Fixes #18870

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-05 14:31:35 +08:00
Wang Yan dbaae9e64e
support OCI-Subject header (#18885) 
fixes #18865
the response header OCI-Subject to indicate to the client that the registry processed the request's subject.

Signed-off-by: wang yan <wangyan@vmware.com>
Co-authored-by: System Administrator <root@wangyanCQFQY.vmware.com>
 2023-07-05 11:25:19 +08:00
Shijun Sun 1d2624eefc
Add worker parameter for GC (#18882) 
1. Related back-end PR #18855

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-04 10:36:39 +08:00
Shijun Sun ef96c729c0
Add costomized banner message UI (#18827) 
1.Fixes #18719
2.Add Banner Message item to configuration
3.Add banner_message property to systeminfo API

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-03 15:58:37 +08:00
Shijun Sun 8fe561865d
Add unit test for hidden columns (#18873) 
1. Fixes #18870

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-07-03 10:58:14 +08:00
stonezdj(Daojun Zhang) d84b1d07d2
Update table scan_report and extract cvss_v3_score from vendor attribute (#18854) 
For better performance when query cve information, add summary information to scan_report
    Extract cve_score from vendor attribute in vulnerability_record
    SQL migrate script for the update

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-06-29 17:30:50 +08:00
Wang Yan 7435c8c5ab
add multiple deletion of GC (#18855) 
User can specify the workers when to issue an GC execution, the maxium count of workers is 5.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-06-29 16:22:18 +08:00
Chlins Zhang 02a1c417d4
refactor: migrate the redis command keys to scan (#18825) 
Refine the cache interface, migrate the Keys to Scan, change the redis
underlying keys command to scan.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-06-29 11:28:19 +08:00
Shijun Sun d36ca805b4
Add new client Podman to the pull command (#18857) 
1.Fixes #18832

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-27 11:12:41 +08:00
Bin Liu 1d6c02f52d
jobservice: update readme (#18849) 
To reflect the newest job interface, and the missing parts of
DB job service logger.

Signed-off-by: bin liu <liubin0329@gmail.com>
 2023-06-27 09:13:47 +08:00
Bin Liu 4035f438fb
jobservice: add DB to job logger config (#18821) 
jobservice: add DB to job logger config in readme

Job logger support file, db and stdout, the comment should
include the type of DB as well as file and stdout.

Signed-off-by: bin liu <liubin0329@gmail.com>
 2023-06-19 14:19:21 +08:00
Shijun Sun b822952537
Update the text for the oidc cli secret tooltip (#18814) 
Update the text for oidc cli secret tooltip
1. Update the text for all the i18n files

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-16 12:29:58 +08:00
Shijun Sun ca94a23a74
Add Podman push command to the UI (#18810) 
1. Fixes #18781

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-13 10:45:05 +08:00
Shijun Sun fc9c68a6fc
Add Details column for gc history (#18797) 
1. Related #18779
2. Show how many blobs and manifest have been deleted and how much space has been freed up

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-12 15:41:50 +08:00
Chlins Zhang c08c7c52a0
fix: optimize the mechanism of quota refresh (#18795) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-06-08 14:19:06 +08:00
rongfu.leng 8251fd2dec
【UT】add unit test for collector system info (#18717) 
add unit test for system collector test

Signed-off-by: lengrongfu <1275177125@qq.com>
 2023-06-08 10:06:09 +08:00
Shijun Sun 2f51daf707
Add a tooltip for slack notification (#18787) 
1.Fixes #18507
2.Remind the users of Slack's rate limits

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-07 16:14:36 +08:00
rongfu.leng 8fe578e7ab
feat: Optimize quota checking when pushing images (#17392) 
Signed-off-by: lengrongfu <1275177125@qq.com>
 2023-06-05 17:19:55 +08:00
Chlins Zhang fbeeaa7537
fix: add checkpoint when enqueue scan tasks for scan all (#18680) 
Fix the scanAll cannot be stopped in case of large number of artifacts,
add the checkpoint before submit scan tasks, mark the scanAll stopped
flag in the redis.

Fixes: #18044

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-06-05 15:12:54 +08:00
Wang Yan 680c78d368
add more details in gc history (#18779) 
Show more infors in the gc history, like the sweep size and how many blobs and manifests were removed by GC.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-06-02 17:33:09 +08:00
Chlins Zhang a98711c0fc
fix: clean up scan executions and reports after deleting artifact (#18693) 
Cleanup the associated resources(scan executions and scan reports) after
deletion of artifact.

Fixes: #18634

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-05-31 14:54:52 +08:00
cui fliter e19ec9623b
Fix: fix function name in comments (#18726) 
fix function name in comments

Signed-off-by: cui fliter <imcusg@gmail.com>
 2023-05-31 10:26:19 +08:00
orblazer b021dbd2d6
fix invalid access action (#18188) 
Signed-off-by: orblazer <orblazer.minecraft@gmail.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-05-30 17:49:01 +08:00
Wang Yan 5c42bc10ec
remove the legacy migration (#18754) 
Delete the legacy migration and artifact abstration code for v2.0

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-05-30 15:17:24 +08:00
guangwu b7b0e43a21
fix: import optimization (#18727) 
Signed-off-by: guoguangwu <guoguangwu@magic-shield.com>
 2023-05-30 13:24:08 +08:00
lishaokai1995 04833d2daf
Fix syntax errors in comments (#18746) 
Signed-off-by: lishaokai1995 <lishaokai1995@126.com>
 2023-05-29 17:31:08 +08:00
rongfu.leng 4652d752b6
【optimization】Use URL.Redacted method repleace redacted (#18716) 
use URL.Redacted method replease redacted

Signed-off-by: lengrongfu <1275177125@qq.com>
 2023-05-29 16:37:51 +08:00
stonezdj(Daojun Zhang) 1b1af4a14c
Return error when proxy cache get too many request error(429) (#18728) 
Add 429 too many request error in http error
  Fixes #18707

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2023-05-29 13:33:46 +08:00
Shijun Sun 11d6bb4437
Add a text to explain the time window for GC (#18735) 
1.Fixes #18692

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-05-26 18:32:19 +02:00
Wang Yan 06aa87a72a
set tag pull time for proxy cache (#18731) 
fixes #18708

to set the pull time of tag for the first time cache the artifact.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-05-26 13:08:37 +08:00
Shijun Sun c399e5ee4a
Improve repo_read_only header on the UI (#18729) 
1. Fixes #18694
2. Now non-system-admin users can also see the repo_read_only header

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-05-24 17:13:33 +08:00
Shijun Sun 43c6586af4
Upgrade Angular and Clarity to the latest version (#18709) 
1.Upgrade Angular to 16.0.2
2.Upgrade Clarity to 15.4.0

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-05-23 15:59:31 +08:00
stonezdj(Daojun Zhang) 9d042ad585
Use subtle.ConstantTimeCompare instead of compare directly (#18697) 
Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-05-22 16:16:52 +08:00
Aklis 6a79de761b
Fix the channel that never receives a value (#18139) 
fix the channel that never receives a value
fix the code with the linter's recommendation by https://github.com/goharbor/harbor/blob/main/CONTRIBUTING.md#develop-build-and-test

Signed-off-by: iAklis <chenpinwei@gmail.com>
 2023-05-19 09:17:46 +08:00
Wang Yan bf7c82b9a8
remove the notary from backend (#18668) 
Since harbor deprecates notary since v2.9.0, this pull request targets to remove the code related with notary.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-05-18 18:47:42 +08:00
Shengwen YU 845bcdb184
fix: add retry on the caller of v2DeleteManifest instead within v2DeleteManifest (#18662) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-05-18 09:35:33 +08:00
MinerYang 954f1f3d06
bump up github.com/distribution/distribution v2.8.2 (#18687) 
Signed-off-by: yminer <yminer@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-05-17 11:58:43 +08:00
Viktor f8e28dbede
Changed logic search projects in gitlab adapter (#18529) 
* fix(gitlab): change logic search projects usage search_namespaces

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>

* tests(gitlab): remove old data and actualization test

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>

* refactor(gitlab): added debug log

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>
(cherry picked from commit 732806221b1c1633682fe1adad4cbcd3a4687d0b)

* lint(gitlab): fix import order

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>

---------

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>
 2023-05-15 13:59:13 +08:00
Eng Zer Jun 18a33c2b40
chore: replace `github.com/ghodss/yaml` with `sigs.k8s.io/yaml` (#18606) 
At the time of making this commit, the package `github.com/ghodss/yaml`
is no longer actively maintained.

`sigs.k8s.io/yaml` is a permanent fork of `ghodss/yaml` and is actively
maintained by Kubernetes SIG.

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
Co-authored-by: MinerYang <yminer@vmware.com>
 2023-05-12 18:21:26 +08:00
Shijun Sun f2fc0f6a99
Remove notary UI (#18666) 
1. Remove notary from the UI
2. Remove notary-related unit test cases

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-05-11 19:23:51 +08:00
Chlins Zhang 36c2b93fe6
fix: sweep executions of image scan job (#18649) 
1. Change the SCAN_ALL job execution retain counts from 5 to 1(per
   current design, only one report be stored for every artifact, so
   retain latest 1 is enough).
2. Enable the sweep for IMAGE_SCAN job(retain latest 1).

Fixes: #18633

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-05-10 13:23:54 +08:00
Peter Dave Hello 0e3e70bc7a
Improve zh-tw (Traditional Chinese) locale (#18608) 
Improve zh-tw locale

Signed-off-by: Peter Dave Hello <hsu@peterdavehello.org>
 2023-05-08 10:55:04 +08:00
Chlins Zhang 362387f914
fix: improve the performance of list artifacts (#18610) 
1. Change the query for listing tasks of scan which can use the db
   index.
2. Add the gin index for task.extra_attrs.report_uuids

Fixes: #18013

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-30 09:10:28 +08:00
Shijun Sun 1bbe8c57e7
Fix message prompt under the header (#18613) 
1.Fixes #18601

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-27 18:03:05 +08:00
MoonStrider bf6389e6c8
fix: error log use wrong variable err (#18602) 
Update manager.go

Signed-off-by: MoonStrider <37744291+dyf991645@users.noreply.github.com>
 2023-04-26 21:10:41 +08:00
MinerYang ebac530b46
add goheader linter settings (#18503) 
fix files for goheader linter

fix copyright 2018/2019

Signed-off-by: yminer <yminer@vmware.com>
 2023-04-25 11:18:42 +08:00
Shijun Sun dd973b1593
Add missing i18n key-value for helm chart (#18578) 
1.Fixes #18572

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-23 15:03:04 +08:00
Shijun Sun e793e2433d
Update position to vertical-align for copy button (#18563) 
Fixes #17906

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-20 15:40:24 +08:00
MinerYang 8df99a5116
bump golang.org/x/net && helm.sh/helm/v3 on main (#18545) 
bump golang.org/x/net v0.9.0 on main

Signed-off-by: yminer <yminer@vmware.com>

bump helm.sh/helm/v3 v3.11.3
 2023-04-18 19:18:04 +08:00
pgillich eec5342490
feat: log with trace ID (#18181) 
feat: log trace ID

Implements #18029

If the Trace ID is sent to the Harbor in HTTP header or the tracing
is enabled (and the Trace ID is generated), the Trace ID will be
added to the log lines as a new field.

Signed-off-by: Peter Gillich <pgillich@gmail.com>
 2023-04-17 15:03:00 +08:00
Shijun Sun de6e517136
Upgrade harbor-portal to v2.9.0 (#18525) 
1.Magrate protractor to cypress as protractor has been deprecated

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-13 18:52:06 +08:00
Chlins Zhang d3d6e29aa3
fix: update stopped execution status immediately instead of async update (#18527) 
Update the stopped execution status immediately becasue the user
experience is not good if wait long time when stop or reschedule a job.

Fixes: #18526

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-13 17:52:41 +08:00
Iceber Gu 3afa525f0b
Change the permissions of the *.go file from 0755 to 0644 (#17919) 
Signed-off-by: Iceber Gu <wei.cai-nat@daocloud.io>
 2023-04-13 09:07:36 +02:00
Danny Kulchinsky 14e4c07d94
GC: correctly handle manifest unknown (404) condition in v2DeleteManifest retry loop (#18386) 
GC: handle manifest unknown (404) during V2 manifest delete retry loop

Signed-off-by: Danny Kulchinsky <dkulchinsky@fastly.com>
 2023-04-12 22:52:52 +02:00
Shijun Sun b201f9864f
Synchronize text modification of quota tooltip to all the i18n files (#18518) 2023-04-12 10:55:02 +03:00
Chlins Zhang b755c43d12
fix: clean the redis if the execution is not found (#18517) 
Delete the execution outdated status key in the redis when the execution
is not found.

Fixes: #18511

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-12 14:17:42 +08:00
Orlix 7edb447e14
Reword quota definitions based on user input (#18512) 
Fixes: https://github.com/goharbor/harbor/issues/17545

Signed-off-by: OrlinVasilev <ovasilev@vmware.com>
 2023-04-12 11:50:33 +08:00
Chlins Zhang 5791f0c979
fix: fix error bitsize of jobservice reaper scan locks (#18487) 
Change the bitSize from 16 to 64 in the jobservice reaper, the 16 is too
small when the redis cursor over the max value of int16.

Fixes: #18486

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-07 10:59:30 +08:00
Chlins Zhang 697f1c79ef
fix: fix the regexp of execution status outdate key (#18481) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-05 13:53:45 +08:00
Chlins Zhang 62bb56daf6
refactor: refresh the execution status in async mode (#18434) 
Refactor the logic for updating the status of execution when receiving
the hook from jobservice, avoid the optimistic lock due to the multiple
tasks update one execution by refreshing the status asynchronously. But
still retain the old way by specifying the flag from ENV.

Fixes: #17584

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-04 16:37:37 +08:00
Wang Yan 60d9664cbc
fix accessory replication issue (#18471) 
Fixes #18404
Support multiple level accessories replication.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-04-04 12:46:46 +08:00
Chlins Zhang a7cef5e24f
fix: wrap schedule/exec/task creation as orm tx (#18458) 
Wrap orm tx when the scheduler try to create the task because submit job
maybe failure depends on the jobservice.

Fixes: #18452

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-04 08:42:18 +08:00
Chlins Zhang 02c51c6b70
fix: correct the retention webhook payload (#18462) 
Fix the incorrect number of total and retained in the retention webhook
payload, and completes the deleted_artifacts field.

Fixes: #18428

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-03 17:51:02 +08:00
Shijun Sun 1499faf67d
Update styles for UI according to the designer's suggestions (#18463) 
1. extend the width for event type label
2. add quotes for Retain image last pull time to make it more understandable

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-03 16:47:21 +08:00
Chlins Zhang ca9e2d2f07
fix: generate uuid as CloudEvents id and add additional requestid (#18451) 
1. Change the the value of CloudEvents id from requestid to uuid
2. Add additional requestid to trace to event

Fixes: #18448

Signed-off-by: chlins <chenyuzh@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-04-03 12:02:19 +08:00
Wang Yan fddfaa7ba5
fix copy artifact issue (#18460) 
To enable the middleware to save the project_blob data, make sure to set the accessories options to true when handling the artifact copy.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-04-03 10:58:17 +08:00
Chlins Zhang cb0749c7ab
fix: add default payload_format for http type webhook (#18445) 
1. Add migration SQL to handle the lost payload format for old policies.
2. Set payload format to 'Default' if not specified for http webhook in the API handler.
3. Fix the migration sql of notification_job

Fixes: #18401, #18453

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-02 15:33:33 +08:00
Chlins Zhang 5d953b48b6
fix: escape the event data for slack webhook payload (#18424) 
Escape the event data of slack webhook as original payload is invalid
when send to slack.

Fixes: #18423

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-31 17:05:10 +08:00
Shijun Sun 95972ba693
Add new app level warning message (#18449) 
1. Show a app level warning if there is a stuck job
2. Chang `Replication finished` to `Replication status changed`

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-31 13:08:57 +08:00
Wang Yan f63865d207
fix the copy artifact issue (#18441) 
support copy artifact with multipe levels of accessories.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-03-30 02:04:22 +08:00
Shijun Sun d22c94b4fa
Remove markdown pipe for webhook payload data (#18439) 
1. Fixes #18435

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-29 12:38:32 +08:00
Chlins Zhang 6e9f72315f
fix: fix the invalid jobid for scan data export (#18398) 
Change the JobId param type from int to string, use int will bring some
problems for encode/decode type mismatch which generate the invalid
repository name.

Fixes: #18380

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-29 10:29:08 +08:00
Shijun Sun 9e0e8e066b
Add copy digest button for accessories (#18433) 
1.Fixes #18406

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-28 20:37:44 +08:00
Shijun Sun 9b593550ab
Upgrade @clr/angular and @clr/ui to 15.0.3 (#18427) 
1.Fixes #18422
2. Upgrade Clarity to 15.0.3 to apply the fix for #18422

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-28 19:38:12 +08:00
Shijun Sun e5e61d4eaa
Correct a grammatical error (#18431) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-28 18:05:22 +08:00
Wang Yan 1bb3914de4
fix referrers api response issue (#18430) 
1, add fitler artifactType to header when the api is called with filter
2, give an empty json body on non aritfact scenario
3, give an empty array on non accessory scenario
4, fix the artifact type filter issue

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-28 13:51:37 +08:00
stonezdj(Daojun Zhang) 088d18bccf
Fix sql error in FixDanglingStateExecution (#18411) 
Fix sql error in fixDanglingStateExecution

  fixes #18408

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-28 12:57:02 +08:00
Wang Yan deaecf2de5
add subject artifact repo (#18394) 
add suject_artifact_repo column in the table artifact_accessory

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-22 21:48:09 +08:00
Chlins Zhang 395ae77d64
fix: change the default max retry count for webhook job to 3 (#18392) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-22 17:36:50 +08:00
Chlins Zhang 6590fe8eef
fix: register sweeper retain counts for purge audit log job (#18390) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-22 15:22:24 +08:00
Wang Yan 2f380495bf
revert subject id in the accessory (#18377) 
DO not replact id with digest and just add digest into the accessory table

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-22 10:58:30 +08:00
stonezdj(Daojun Zhang) 46fa91f866
Fix dangling state execution (#18272) 
Add max update hour and max dangling hour setting in config.yaml
  Fixes #17611

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-21 18:48:14 +08:00
Chlins Zhang 67d3f9add8
feat: support configurate the http client timeout for webhook job (#18382) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-21 11:54:10 +08:00
Chlins Zhang f21b1481bb
refactor: refactor the old goroutine execution sweep (#18361) 
refactor: refactor the old goroutine execution sweep to global execution sweep job

1. Delete the old goroutine execution sweeper when create execution.(in the case of high concurrency can cause goroutine backlogs, affect the performance of core)
2. Introduce the new way to sweep executions, a global scheduled job will take the work.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-21 10:10:55 +08:00
Shijun Sun 2b3f178a50
Upgrade Golang packages (#18376) 
1. Upgrade golang.org/x/net to 0.7.0
2. Upgrade helm.sh/helm/v3 to 3.11.1

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-20 15:59:37 +08:00
dependabot[bot] 79c0a22ce8
Bump webpack from 5.74.0 to 5.76.0 in /src/portal/app-swagger-ui (#18352) 
Bumps [webpack](https://github.com/webpack/webpack) from 5.74.0 to 5.76.0.
- [Release notes](https://github.com/webpack/webpack/releases)
- [Commits](https://github.com/webpack/webpack/compare/v5.74.0...v5.76.0)

---
updated-dependencies:
- dependency-name: webpack
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-03-20 15:06:00 +08:00
Wang Yan bb291aaa16
add middleware for artifact with subject (#18369) 
As for the distribution spec 1.1, it supports client to push an manifest with subject field. By leverging this fidle, harbor could build up the linkage between the subject artifact and it's accessories.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-03-19 20:09:41 +08:00
Shijun Sun e086710173
Fix some UI issues (#18371) 
1. Fixes #17892
2. Redirect to default page when redirectUrl starts with /account/sign-in

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-17 18:52:23 +08:00
Daniel Jiang bea8dece07
feat: upgrade golang to 1.20.1 (#18370) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-03-17 17:49:44 +08:00
Shijun Sun 339f5b106b
Make label filter editable for replication rule (#18357) 
1. Fixes #15825
2. Now, you can input labels or select them from the candidates

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-17 15:48:03 +08:00
MinerYang e76aff6a0a
add external redis username config to support redis6 ACL (#18364) 
add external redis username o support redis6 ACL

Signed-off-by: yminer <yminer@vmware.com>
 2023-03-17 14:16:19 +08:00
Shijun Sun 53d86f872e
Support accessory recursion for artifact list (#18366) 
1. Update accessory UI to support recursion

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-17 13:01:24 +08:00
Shijun Sun 321d8a0885
Update UI packages (#18312) 
1. Update Angular packages to 15.2.1
2. Update swagger-ui to 4.17.1
3. Update Clarity to 15.0.1 and remove datepickerToggle property

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-17 12:14:16 +08:00
Thomas Coudert 5287c0e79d
Improve Portal french translation (#18289) 
* Remove useless translation values and fix variable name typo

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>

* Improve Portal French translation

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>

* Translate Portal CVE_EXPORT in french

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>
 2023-03-15 14:25:14 +08:00
Back Yu fe236ecd2e
Support vpc and internal network (goharbor#17488) (#17489) 
Signed-off-by: Back Yu <yhfszb@gmail.com>
 2023-03-15 11:04:45 +08:00
Shijun Sun 1acba0c3bb
Add dynamic column support (#18331) 
1. Fixes #17815
2. Add dynamic column support for replication rule list  and artifact list

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-14 14:41:16 +08:00
Shijun Sun a1d397842d
Improve webhook UI (#18325) 
1. Add text format for payload data
2. Delete payload_format for Slack

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-14 13:28:12 +08:00
Chlins Zhang 65e675d2e6
feat: integrate CloudEvents to webhook (#18322) 
Integrate CloudEvents as payload format for webhook.

Closes: #17748

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-14 10:44:25 +08:00
Wang Yan 9b61d34c4c
add referrers api (#18324) 
add referrers api

The define of referrers api in the upstream oci spec: https://github.com/opencontainers/distribution-spec/blob/v1.1.0-rc1/spec.md#listing-referrers

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-12 15:28:37 +08:00
stonezdj(Daojun Zhang) ab636fe3da
Remove go routine to reloadSetting (#18318) 
Config is cached in redis
  Fixes #18189

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-11 15:45:50 +08:00
Shengwen YU 4efee54f07
feat: upgrade mockery version (#18332) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-03-11 08:16:11 +08:00
Shijun Sun ec7c99c270
Add agent config for ng serve (#18323) 
1. Add agent setting for the proxy config
2. Add https-proxy-agent package

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-10 17:22:11 +08:00
stonezdj(Daojun Zhang) e8e56fd31d
Check tag name for OCI spec (#18311) 
Verify tag name with OCI spec when creating tag

  Fixes #18073

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-10 10:40:37 +08:00
stonezdj(Daojun Zhang) 5c9ce836cf
Skip robot account for oidc_cli middleware (#18317) 
Fixes #15253

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-09 15:41:08 +08:00
Wang Yan 5a065d1cd8
fix robot account list project (#18304) 
Fixes #17636, to determine permissions for the project resource, the path should be /project instead of /project/project.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-09 14:16:18 +08:00
Wang Yan 295260b7a3
replace subject id with digest (#18278) 
Since it has to support push subject and accessories in either order, it has to replace digest with id

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-08 17:03:12 +08:00
Yang Jiao fecee37439
Update robot account to skip NotFoundErr (#18321) 
Fix #18320

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
 2023-03-08 15:39:50 +08:00
hyeyoung-leee 2c287cf27a
Modified to check the expiration time of the allowlist when determining the vulnerability of an artifact (#18106) 
Signed-off-by: hyeyoung-lee <hyeyoung.lee@nhn.com>
 2023-03-08 11:25:40 +08:00
Shijun Sun 1238384428
Add logs column for worker datagrid (#18307) 
1. Related back-end PR #18261

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-07 19:58:39 +08:00
Shijun Sun 38d7eda1ad
Update UI for the deprecation of Artifact Hub (#18303) 
1. Update edit-registry page to enable the edition for Artifact Hub
2. Update edit-replication-rule page to enable the edition for rules contain Artifact Hub

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-07 18:12:08 +08:00
Shijun Sun ba9078f463
Enhance webhook UI (#18291) 
1. Add execution list for a certain webhook policy
  2. Add task list for a certain execution

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-07 17:12:18 +08:00
stonezdj(Daojun Zhang) 5c0266e719
Get job log by job_id in worker (#18261) 
Get job by job_id in redis

  Get the last 10MB of data if it exceeds 10MB

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-06 13:19:10 +08:00
Shijun Sun 6f01d7480b
Add retry times for calling CVE data export execution list API (#18297) 
1.Fixes #17879
2.Add retry times to avoid endless API calls for CVE data export execution list API

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-03 14:44:36 +08:00
Chlins Zhang 90db04e92d
refactor: refact the webhook API and life process (#18255) 
refactor: refact the notification job API and life process

1. Introduce new APIs for webhook jobs management.
2. Refact legacy APIs for backforward compatible.
3. Migrate the webhook jobs process to unified execution/task framework.

Closes: #18210

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-03 10:17:47 +08:00
stonezdj(Daojun Zhang) 320c64e433
Sort user and usergroup by most match order (#18273) 
fixes #17859

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-01 10:11:21 +08:00
Shijun Sun 9973d99f3e
Remove chart api (#18265) 
* remove chart api from swagger

Delete the api path for chart in the swagger

Signed-off-by: Wang Yan <wangyan@vmware.com>

* Remove chart APIs
   1. Remove some chart-related steps for Dockerfile for portal  container
   2. Remove chart APIs for API center

Signed-off-by: AllForNothing <sshijun@vmware.com>

---------

Signed-off-by: Wang Yan <wangyan@vmware.com>
Signed-off-by: AllForNothing <sshijun@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-02-24 14:47:42 +08:00
Shijun Sun a79c0ad496
Add next scheduled time for tag retention (#18223) 
1. Add next scheduled time UI
   2. Update font style

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-02-22 12:26:58 +08:00
Shijun Sun c5640acd7b
Add scanner_skip_update_pulltime property for system setting (#18214) 
1. Related backend PR #17807

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-02-22 10:58:01 +08:00
Chlins Zhang 4141d77407
fix: remove noise log when core started (#18260) 
Fixes: #18126

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-02-21 17:38:42 +08:00
stonezdj(Daojun Zhang) 58054c0ce8
Change queue name for purge audit log and filter the old one (#18182) 
Fixes #18121
 Refactor job name with VendorType prefix, make sure job queue name and vendor type in execution and task are identical

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-02-20 16:03:22 +08:00
stonezdj(Daojun Zhang) d03f0dcf2d
Skip to update pull time and pull count for scanner robot account (#17807) 
Add prefix for scanner robot account
   Fixes #14638

Signed-off-by: stonezdj <daojunz@vmware.com>

# Conflicts:
#	api/v2.0/swagger.yaml
#	src/common/const.go
#	src/lib/config/metadata/metadatalist.go
 2023-02-20 15:09:21 +08:00
Chlins Zhang da1637e1d3
fix: resolve the oidc or ldap group user cannot export cve (#18219) 
Remove the project filter in the scan data export job as they have been
validated by API handler, fix the oidc or ldap group users cannot export
cve.

Fixes: #18112

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-02-20 14:22:27 +08:00
Shengwen YU 94dbc3fa8f
fix: add "next_scheduled_time" (#18102) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-02-17 17:54:53 +08:00
Wang Yan 738fde7d3b
remove chartmuseum backend (#18191) 
Harbor deprecates chartmuseum as of v2.8.0

Epic: https://github.com/goharbor/harbor/issues/17958

Discussion: https://github.com/goharbor/harbor/discussions/15057

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-02-16 18:11:05 +08:00
Shijun Sun ec5afc3257
Display error message by defaul for event panel (#18226) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-02-16 10:30:21 +08:00
Chlins Zhang 47137605c9
fix: update the replication API handler (#18197) 
1. Check execution before stop replication execution.
2. Check execution before list replication tasks.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-02-14 13:11:27 +08:00
Shijun Sun cece65ccf7
Translate English to Chinese for primary auth mode tooltip (#18196) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-02-13 12:12:17 +08:00
Fish-pro 2f04d4f810
chore: clean up no longer support linters for golang-lint (#18165) 
Clean up no longer support linters for golang-lint

Signed-off-by: Fish-pro <zechun.chen@daocloud.io>
 2023-02-10 16:27:37 +01:00
Shengwen YU a4c95fa030
fix: reset user password (#18192) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-02-09 18:39:13 +08:00
Maksym Trofimenko 68fb01813e
Allow the Identity Provider to be the primary auth method in Harbor. (#17627) 
Allow the Identity Provider to be the primary auth method in Harbor

Signed-off-by: Maksym Trofimenko <maksym@container-registry.com>
 2023-02-08 18:11:08 +01:00
Shijun Sun ff9dcd5483
Remove helm chart UI (#18099) 
1.Remove all helm chart v2 related code

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-02-08 16:47:03 +08:00
Shijun Sun 9d30955607
Support searching artifacts by specified tag name (#18175) 
1.Fixes #18082
  2.Update CSS

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-02-08 16:00:37 +08:00
Shijun Sun fdf93470c5
Correct total count for schedule list datagrid (#18148) 
1.Fixes #18120

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-02-08 12:01:01 +08:00
Shengwen YU 62c033b6d3
fix retention/immutable API issue (#18158) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-02-06 14:42:15 +08:00
Caleb Lloyd 901cc17c67
aws auth use default creds when none are supplied (#17932) 
Signed-off-by: Caleb Lloyd <caleblloyd@gmail.com>
Co-authored-by: Vadim Bauer <vb@container-registry.com>
 2023-02-03 21:52:53 +01:00
Chlins Zhang bfe4362a67
fix: remove the scan exports volume (#18107) 
1. Change the Export CVE temporary file directory to /tmp.
2. Remove the scan data export volume in Dockerfile and docker-compose
   yaml.

Fixes: #18067

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-01-31 17:30:47 +08:00
rongfu.leng 0fb076a09a
add match many version pattern test (#18092) 
Signed-off-by: lengrongfu <1275177125@qq.com>

Signed-off-by: lengrongfu <1275177125@qq.com>
 2023-01-16 16:40:19 +08:00
Shijun Sun 2ea53444e6
Add i18n support for Clarity components (#18076) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-01-11 10:29:05 +08:00
Noah Tang a9a67462dc
add job status unit test (#18057) 
Signed-off-by: coderth <coderth@outlook.com>

Signed-off-by: coderth <coderth@outlook.com>
 2023-01-10 13:28:28 +08:00
Shijun Sun a86740e82a
Update datePicker component (#18070) 
1.Fix date validator
2.Add i18n support

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-01-06 11:36:01 +08:00
Shijun Sun 2361ae161f
Upgrade Angular and Clarity to the latest version (#18059) 
Upgrade Angular and Clarity
  1.Upgrade related libraries
  2.Fix breaking changes

Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-01-05 10:42:59 +08:00
MinerYang ba5baca769
bump up helm/v3/pkg to v3.10.3 on main (#18050) 
Signed-off-by: yminer <yminer@vmware.com>

Signed-off-by: yminer <yminer@vmware.com>
 2023-01-04 15:42:32 +08:00
Aleksandr Chebotov 452ae168cc
fix purge info typo (#18023) 
Signed-off-by: Aleksandr Chebotov <alk.chebotov@gmail.com>
 2023-01-03 13:48:14 +08:00
Shijun Sun d87d906c84
Switch listUsers to searchUsers for adding project member (#18022) 
Fixes #18000

Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-12-23 16:09:22 +08:00
Kenton Groombridge 76757a5334
i18n: fix password+secret limit tooltips (#17916) 
Some translations specify the (older) limit of 20 characters for
passwords and secrets. Update these to specify a limit of 128
characters.

Signed-off-by: Kenton Groombridge <me@concord.sh>

Signed-off-by: Kenton Groombridge <me@concord.sh>
 2022-12-21 10:52:06 +08:00
Christian Zenker 9674a51b83
fix: Don't supress redis error messages to make debugging easier (#17986) 
Signed-off-by: Christian Zenker <christian.zenker@aoe.com>

Signed-off-by: Christian Zenker <christian.zenker@aoe.com>
 2022-12-15 10:42:16 +08:00
Chlins Zhang b0a30b9a2f
fix: fix the time duration type duplicated parse for config (#17981) 
Fix the time duration type duplicated parse for config, maintaining the idempotency of set and get operations.

Signed-off-by: chlins <chenyuzh@vmware.com>

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-12-13 18:22:41 +08:00
Shijun Sun 86e34c8e59
Fix some UI issues (#17964) 
1.Fixes #17874
   2.Correct some i18n items

Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-12-09 15:03:30 +08:00
stonezdj(Daojun Zhang) ceb130e617
Avoid internal error in the UI when reset a schedule (#17946) 
fixes #17926

Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-12-08 20:43:44 +08:00
stonezdj(Daojun Zhang) c4a58433cf
Update the log information in proxy cache (#17936) 
fixes #17933

Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-12-08 13:50:37 +08:00
Wang Yan d83cee083a
remove artifact_blob with aritfact deletion (#17913) 
fixes #17857

It needs to clean the artifact_blob records on artifact deletion in GC

Signed-off-by: Wang Yan <wangyan@vmware.com>

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2022-12-07 13:37:10 +08:00
Iceber Gu a90181e312
fix the setting of data slice length for tablewriter (#17918) 
Signed-off-by: Iceber Gu <wei.cai-nat@daocloud.io>
 2022-12-07 13:19:08 +08:00
little_an 8cc16de180
fix dragonfly response when p2p preheat (#15916) 
* fix dragonfly response when p2p preheat

Signed-off-by: anyiwei <anyiwei@didichuxing.com>
 2022-12-06 16:12:21 +08:00
Iceber Gu 7dc452ccab
controller/robot: use global regexp vars (#17915) 
Signed-off-by: Iceber Gu <wei.cai-nat@daocloud.io>

Signed-off-by: Iceber Gu <wei.cai-nat@daocloud.io>
 2022-12-06 15:59:37 +08:00
MinerYang e558befc8e
bump up golang.org/x/net to v0.2.0 (#17910) 
Signed-off-by: yminer <yminer@vmware.com>
 2022-12-06 03:59:36 +08:00
Chlins Zhang 287f334327
fix: align some configuration api fields validation with frontend (#17903) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-12-05 15:52:41 +08:00
stonezdj(Daojun Zhang) 2f5827a42e
Remove unused go-sql-driver/mysql (#17895) 
Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-12-02 16:49:28 +08:00
Wang Yan 277c78e212
update system artifact schedult timeout (#17902) 
fixes #17887
enhance the timeout to 5m to avoid system artifact failed to schedule in the helm base installation.

Signed-off-by: Wang Yan <wangyan@vmware.com>

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2022-12-02 14:30:05 +08:00
Shijun Sun 5f1dff32c2
Change inputs type from text to number (#17897) 
1.Fixes #17890
   2.Update isDBAuth function

Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-12-02 12:51:38 +08:00
stonezdj(Daojun Zhang) 64c03e8679
Update the execution status after tasks stopped (#17875) 
Fixes #17862

Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-12-01 21:17:35 +08:00
Shijun Sun 491dcf7d9b
Update jobservice dashboard UI (#17894) 
1.Fixes #17855, #17874 and #17863
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-12-01 17:01:59 +08:00
Jianwei Guo cb11540a14
add parameters for PostgreSQL (#16641) 
Signed-off-by: sayaoailun <guojianwei007@126.com>
 2022-11-30 19:08:08 +08:00
Shijun Sun 927a055aa9
Update i18n for group filter and schedule list (#17884) 
Fixes #17868 and #17853

Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-30 14:35:01 +08:00
stonezdj(Daojun Zhang) 402363d50b
Remove job parameters and schedule extra attribute (#17878) 
Remove job parameters from job

  Remove extra attribute and cron type from schedule
  fixes #17866

Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-11-28 17:45:26 +08:00
stonezdj(Daojun Zhang) 80999f28ee
Keep CheckInAt time empty when it is empty (#17877) 
Fixes #17860

Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-11-28 14:02:30 +08:00
MinerYang f97aedfb5c
Increase golangci-lint timeout value (#17841) 
increase golangci-lint timeout value

Signed-off-by: yminer <yminer@vmware.com>

Signed-off-by: yminer <yminer@vmware.com>
 2022-11-25 11:10:21 +08:00
stonezdj(Daojun Zhang) 619747fc68
Stop Pending Job cannot update status (#17842) 
Convert the redis range result into struct and extract job id from it
  Add more log when get redis config fails

Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-11-24 20:29:50 +08:00
Shijun Sun d079034b23
Update schedule list (#17851) 
1.Add Cron and Cron Type columns

Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-24 18:51:40 +08:00
Wang Yan 18a3373725
bump beego (#17801) 
* bump beego

upgrade beego version from v1.10.12 to v2.0.5

1, beego v2 vserver/web refactor
2, beego v2 context refactor
3, beego v2 session refactor
4, beego v2 cache refactor
5, beego v2 orm refactor

Signed-off-by: MinerYang <yminer@vmware.com>
 2022-11-24 18:07:42 +08:00
stonezdj(Daojun Zhang) f8628258bc
Add Cron, CronType and Update Time for schedule (#17844) 
Remove create time because update time is added

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-11-24 10:38:52 +08:00
Shijun Sun fcf0e2014f
Update English text for job service UI (#17832) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-23 18:19:45 +08:00
sluetze a826720cc9
Updated German Translation (#17829) 2022-11-21 14:43:26 +01:00
stonezdj(Daojun Zhang) 4b7d45513e
Fix issue related to redhat registry proxy cache (#17789) 
fixes #16495

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-11-18 17:17:39 +08:00