Upstream/harbor
1
0
Fork 0
mirror of https://github.com/goharbor/harbor.git synced 2024-11-15 23:05:57 +01:00
Code Issues Projects Releases Wiki Activity
12,029 Commits 49 Branches 315 Tags 351 MiB
da3c85be5a
Commit Graph

5870 Commits

Author SHA1 Message Date
Wang Yan
7435c8c5ab
add multiple deletion of GC (#18855) 
User can specify the workers when to issue an GC execution, the maxium count of workers is 5.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-06-29 16:22:18 +08:00
Chlins Zhang
02a1c417d4
refactor: migrate the redis command keys to scan (#18825) 
Refine the cache interface, migrate the Keys to Scan, change the redis
underlying keys command to scan.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-06-29 11:28:19 +08:00
Shijun Sun
d36ca805b4
Add new client Podman to the pull command (#18857) 
1.Fixes #18832

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-27 11:12:41 +08:00
Bin Liu
1d6c02f52d
jobservice: update readme (#18849) 
To reflect the newest job interface, and the missing parts of
DB job service logger.

Signed-off-by: bin liu <liubin0329@gmail.com>
 2023-06-27 09:13:47 +08:00
Bin Liu
4035f438fb
jobservice: add DB to job logger config (#18821) 
jobservice: add DB to job logger config in readme

Job logger support file, db and stdout, the comment should
include the type of DB as well as file and stdout.

Signed-off-by: bin liu <liubin0329@gmail.com>
 2023-06-19 14:19:21 +08:00
Shijun Sun
b822952537
Update the text for the oidc cli secret tooltip (#18814) 
Update the text for oidc cli secret tooltip
1. Update the text for all the i18n files

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-16 12:29:58 +08:00
Shijun Sun
ca94a23a74
Add Podman push command to the UI (#18810) 
1. Fixes #18781

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-13 10:45:05 +08:00
Shijun Sun
fc9c68a6fc
Add Details column for gc history (#18797) 
1. Related #18779
2. Show how many blobs and manifest have been deleted and how much space has been freed up

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-12 15:41:50 +08:00
Chlins Zhang
c08c7c52a0
fix: optimize the mechanism of quota refresh (#18795) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-06-08 14:19:06 +08:00
rongfu.leng
8251fd2dec
【UT】add unit test for collector system info (#18717) 
add unit test for system collector test

Signed-off-by: lengrongfu <1275177125@qq.com>
 2023-06-08 10:06:09 +08:00
Shijun Sun
2f51daf707
Add a tooltip for slack notification (#18787) 
1.Fixes #18507
2.Remind the users of Slack's rate limits

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-06-07 16:14:36 +08:00
rongfu.leng
8fe578e7ab
feat: Optimize quota checking when pushing images (#17392) 
Signed-off-by: lengrongfu <1275177125@qq.com>
 2023-06-05 17:19:55 +08:00
Chlins Zhang
fbeeaa7537
fix: add checkpoint when enqueue scan tasks for scan all (#18680) 
Fix the scanAll cannot be stopped in case of large number of artifacts,
add the checkpoint before submit scan tasks, mark the scanAll stopped
flag in the redis.

Fixes: #18044

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-06-05 15:12:54 +08:00
Wang Yan
680c78d368
add more details in gc history (#18779) 
Show more infors in the gc history, like the sweep size and how many blobs and manifests were removed by GC.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-06-02 17:33:09 +08:00
Chlins Zhang
a98711c0fc
fix: clean up scan executions and reports after deleting artifact (#18693) 
Cleanup the associated resources(scan executions and scan reports) after
deletion of artifact.

Fixes: #18634

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-05-31 14:54:52 +08:00
cui fliter
e19ec9623b
Fix: fix function name in comments (#18726) 
fix function name in comments

Signed-off-by: cui fliter <imcusg@gmail.com>
 2023-05-31 10:26:19 +08:00
orblazer
b021dbd2d6
fix invalid access action (#18188) 
Signed-off-by: orblazer <orblazer.minecraft@gmail.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-05-30 17:49:01 +08:00
Wang Yan
5c42bc10ec
remove the legacy migration (#18754) 
Delete the legacy migration and artifact abstration code for v2.0

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-05-30 15:17:24 +08:00
guangwu
b7b0e43a21
fix: import optimization (#18727) 
Signed-off-by: guoguangwu <guoguangwu@magic-shield.com>
 2023-05-30 13:24:08 +08:00
lishaokai1995
04833d2daf
Fix syntax errors in comments (#18746) 
Signed-off-by: lishaokai1995 <lishaokai1995@126.com>
 2023-05-29 17:31:08 +08:00
rongfu.leng
4652d752b6
【optimization】Use URL.Redacted method repleace redacted (#18716) 
use URL.Redacted method replease redacted

Signed-off-by: lengrongfu <1275177125@qq.com>
 2023-05-29 16:37:51 +08:00
stonezdj(Daojun Zhang)
1b1af4a14c
Return error when proxy cache get too many request error(429) (#18728) 
Add 429 too many request error in http error
  Fixes #18707

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2023-05-29 13:33:46 +08:00
Shijun Sun
11d6bb4437
Add a text to explain the time window for GC (#18735) 
1.Fixes #18692

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-05-26 18:32:19 +02:00
Wang Yan
06aa87a72a
set tag pull time for proxy cache (#18731) 
fixes #18708

to set the pull time of tag for the first time cache the artifact.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-05-26 13:08:37 +08:00
Shijun Sun
c399e5ee4a
Improve repo_read_only header on the UI (#18729) 
1. Fixes #18694
2. Now non-system-admin users can also see the repo_read_only header

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-05-24 17:13:33 +08:00
Shijun Sun
43c6586af4
Upgrade Angular and Clarity to the latest version (#18709) 
1.Upgrade Angular to 16.0.2
2.Upgrade Clarity to 15.4.0

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-05-23 15:59:31 +08:00
stonezdj(Daojun Zhang)
9d042ad585
Use subtle.ConstantTimeCompare instead of compare directly (#18697) 
Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-05-22 16:16:52 +08:00
Aklis
6a79de761b
Fix the channel that never receives a value (#18139) 
fix the channel that never receives a value
fix the code with the linter's recommendation by https://github.com/goharbor/harbor/blob/main/CONTRIBUTING.md#develop-build-and-test

Signed-off-by: iAklis <chenpinwei@gmail.com>
 2023-05-19 09:17:46 +08:00
Wang Yan
bf7c82b9a8
remove the notary from backend (#18668) 
Since harbor deprecates notary since v2.9.0, this pull request targets to remove the code related with notary.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-05-18 18:47:42 +08:00
Shengwen YU
845bcdb184
fix: add retry on the caller of v2DeleteManifest instead within v2DeleteManifest (#18662) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-05-18 09:35:33 +08:00
MinerYang
954f1f3d06
bump up github.com/distribution/distribution v2.8.2 (#18687) 
Signed-off-by: yminer <yminer@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-05-17 11:58:43 +08:00
Viktor
f8e28dbede
Changed logic search projects in gitlab adapter (#18529) 
* fix(gitlab): change logic search projects usage search_namespaces

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>

* tests(gitlab): remove old data and actualization test

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>

* refactor(gitlab): added debug log

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>
(cherry picked from commit 732806221b1c1633682fe1adad4cbcd3a4687d0b)

* lint(gitlab): fix import order

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>

---------

Signed-off-by: lxShaDoWxl <lxshadowxkingxl@gmail.com>
 2023-05-15 13:59:13 +08:00
Eng Zer Jun
18a33c2b40
chore: replace github.com/ghodss/yaml with sigs.k8s.io/yaml (#18606) 
At the time of making this commit, the package `github.com/ghodss/yaml`
is no longer actively maintained.

`sigs.k8s.io/yaml` is a permanent fork of `ghodss/yaml` and is actively
maintained by Kubernetes SIG.

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
Co-authored-by: MinerYang <yminer@vmware.com>
 2023-05-12 18:21:26 +08:00
Shijun Sun
f2fc0f6a99
Remove notary UI (#18666) 
1. Remove notary from the UI
2. Remove notary-related unit test cases

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-05-11 19:23:51 +08:00
Chlins Zhang
36c2b93fe6
fix: sweep executions of image scan job (#18649) 
1. Change the SCAN_ALL job execution retain counts from 5 to 1(per
   current design, only one report be stored for every artifact, so
   retain latest 1 is enough).
2. Enable the sweep for IMAGE_SCAN job(retain latest 1).

Fixes: #18633

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-05-10 13:23:54 +08:00
Peter Dave Hello
0e3e70bc7a
Improve zh-tw (Traditional Chinese) locale (#18608) 
Improve zh-tw locale

Signed-off-by: Peter Dave Hello <hsu@peterdavehello.org>
 2023-05-08 10:55:04 +08:00
Chlins Zhang
362387f914
fix: improve the performance of list artifacts (#18610) 
1. Change the query for listing tasks of scan which can use the db
   index.
2. Add the gin index for task.extra_attrs.report_uuids

Fixes: #18013

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-30 09:10:28 +08:00
Shijun Sun
1bbe8c57e7
Fix message prompt under the header (#18613) 
1.Fixes #18601

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-27 18:03:05 +08:00
MoonStrider
bf6389e6c8
fix: error log use wrong variable err (#18602) 
Update manager.go

Signed-off-by: MoonStrider <37744291+dyf991645@users.noreply.github.com>
 2023-04-26 21:10:41 +08:00
MinerYang
ebac530b46
add goheader linter settings (#18503) 
fix files for goheader linter

fix copyright 2018/2019

Signed-off-by: yminer <yminer@vmware.com>
 2023-04-25 11:18:42 +08:00
Shijun Sun
dd973b1593
Add missing i18n key-value for helm chart (#18578) 
1.Fixes #18572

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-23 15:03:04 +08:00
Shijun Sun
e793e2433d
Update position to vertical-align for copy button (#18563) 
Fixes #17906

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-20 15:40:24 +08:00
MinerYang
8df99a5116
bump golang.org/x/net && helm.sh/helm/v3 on main (#18545) 
bump golang.org/x/net v0.9.0 on main

Signed-off-by: yminer <yminer@vmware.com>

bump helm.sh/helm/v3 v3.11.3
 2023-04-18 19:18:04 +08:00
pgillich
eec5342490
feat: log with trace ID (#18181) 
feat: log trace ID

Implements #18029

If the Trace ID is sent to the Harbor in HTTP header or the tracing
is enabled (and the Trace ID is generated), the Trace ID will be
added to the log lines as a new field.

Signed-off-by: Peter Gillich <pgillich@gmail.com>
 2023-04-17 15:03:00 +08:00
Shijun Sun
de6e517136
Upgrade harbor-portal to v2.9.0 (#18525) 
1.Magrate protractor to cypress as protractor has been deprecated

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-13 18:52:06 +08:00
Chlins Zhang
d3d6e29aa3
fix: update stopped execution status immediately instead of async update (#18527) 
Update the stopped execution status immediately becasue the user
experience is not good if wait long time when stop or reschedule a job.

Fixes: #18526

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-13 17:52:41 +08:00
Iceber Gu
3afa525f0b
Change the permissions of the *.go file from 0755 to 0644 (#17919) 
Signed-off-by: Iceber Gu <wei.cai-nat@daocloud.io>
 2023-04-13 09:07:36 +02:00
Danny Kulchinsky
14e4c07d94
GC: correctly handle manifest unknown (404) condition in v2DeleteManifest retry loop (#18386) 
GC: handle manifest unknown (404) during V2 manifest delete retry loop

Signed-off-by: Danny Kulchinsky <dkulchinsky@fastly.com>
 2023-04-12 22:52:52 +02:00
Shijun Sun
b201f9864f
Synchronize text modification of quota tooltip to all the i18n files (#18518) 2023-04-12 10:55:02 +03:00
Chlins Zhang
b755c43d12
fix: clean the redis if the execution is not found (#18517) 
Delete the execution outdated status key in the redis when the execution
is not found.

Fixes: #18511

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-12 14:17:42 +08:00
Orlix
7edb447e14
Reword quota definitions based on user input (#18512) 
Fixes: https://github.com/goharbor/harbor/issues/17545

Signed-off-by: OrlinVasilev <ovasilev@vmware.com>
 2023-04-12 11:50:33 +08:00
Chlins Zhang
5791f0c979
fix: fix error bitsize of jobservice reaper scan locks (#18487) 
Change the bitSize from 16 to 64 in the jobservice reaper, the 16 is too
small when the redis cursor over the max value of int16.

Fixes: #18486

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-07 10:59:30 +08:00
Chlins Zhang
697f1c79ef
fix: fix the regexp of execution status outdate key (#18481) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-05 13:53:45 +08:00
Chlins Zhang
62bb56daf6
refactor: refresh the execution status in async mode (#18434) 
Refactor the logic for updating the status of execution when receiving
the hook from jobservice, avoid the optimistic lock due to the multiple
tasks update one execution by refreshing the status asynchronously. But
still retain the old way by specifying the flag from ENV.

Fixes: #17584

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-04 16:37:37 +08:00
Wang Yan
60d9664cbc
fix accessory replication issue (#18471) 
Fixes #18404
Support multiple level accessories replication.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-04-04 12:46:46 +08:00
Chlins Zhang
a7cef5e24f
fix: wrap schedule/exec/task creation as orm tx (#18458) 
Wrap orm tx when the scheduler try to create the task because submit job
maybe failure depends on the jobservice.

Fixes: #18452

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-04 08:42:18 +08:00
Chlins Zhang
02c51c6b70
fix: correct the retention webhook payload (#18462) 
Fix the incorrect number of total and retained in the retention webhook
payload, and completes the deleted_artifacts field.

Fixes: #18428

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-03 17:51:02 +08:00
Shijun Sun
1499faf67d
Update styles for UI according to the designer's suggestions (#18463) 
1. extend the width for event type label
2. add quotes for Retain image last pull time to make it more understandable

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-04-03 16:47:21 +08:00
Chlins Zhang
ca9e2d2f07
fix: generate uuid as CloudEvents id and add additional requestid (#18451) 
1. Change the the value of CloudEvents id from requestid to uuid
2. Add additional requestid to trace to event

Fixes: #18448

Signed-off-by: chlins <chenyuzh@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-04-03 12:02:19 +08:00
Wang Yan
fddfaa7ba5
fix copy artifact issue (#18460) 
To enable the middleware to save the project_blob data, make sure to set the accessories options to true when handling the artifact copy.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-04-03 10:58:17 +08:00
Chlins Zhang
cb0749c7ab
fix: add default payload_format for http type webhook (#18445) 
1. Add migration SQL to handle the lost payload format for old policies.
2. Set payload format to 'Default' if not specified for http webhook in the API handler.
3. Fix the migration sql of notification_job

Fixes: #18401, #18453

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-04-02 15:33:33 +08:00
Chlins Zhang
5d953b48b6
fix: escape the event data for slack webhook payload (#18424) 
Escape the event data of slack webhook as original payload is invalid
when send to slack.

Fixes: #18423

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-31 17:05:10 +08:00
Shijun Sun
95972ba693
Add new app level warning message (#18449) 
1. Show a app level warning if there is a stuck job
2. Chang `Replication finished` to `Replication status changed`

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-31 13:08:57 +08:00
Wang Yan
f63865d207
fix the copy artifact issue (#18441) 
support copy artifact with multipe levels of accessories.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-03-30 02:04:22 +08:00
Shijun Sun
d22c94b4fa
Remove markdown pipe for webhook payload data (#18439) 
1. Fixes #18435

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-29 12:38:32 +08:00
Chlins Zhang
6e9f72315f
fix: fix the invalid jobid for scan data export (#18398) 
Change the JobId param type from int to string, use int will bring some
problems for encode/decode type mismatch which generate the invalid
repository name.

Fixes: #18380

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-29 10:29:08 +08:00
Shijun Sun
9e0e8e066b
Add copy digest button for accessories (#18433) 
1.Fixes #18406

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-28 20:37:44 +08:00
Shijun Sun
9b593550ab
Upgrade @clr/angular and @clr/ui to 15.0.3 (#18427) 
1.Fixes #18422
2. Upgrade Clarity to 15.0.3 to apply the fix for #18422

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-28 19:38:12 +08:00
Shijun Sun
e5e61d4eaa
Correct a grammatical error (#18431) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-28 18:05:22 +08:00
Wang Yan
1bb3914de4
fix referrers api response issue (#18430) 
1, add fitler artifactType to header when the api is called with filter
2, give an empty json body on non aritfact scenario
3, give an empty array on non accessory scenario
4, fix the artifact type filter issue

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-28 13:51:37 +08:00
stonezdj(Daojun Zhang)
088d18bccf
Fix sql error in FixDanglingStateExecution (#18411) 
Fix sql error in fixDanglingStateExecution

  fixes #18408

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-28 12:57:02 +08:00
Wang Yan
deaecf2de5
add subject artifact repo (#18394) 
add suject_artifact_repo column in the table artifact_accessory

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-22 21:48:09 +08:00
Chlins Zhang
395ae77d64
fix: change the default max retry count for webhook job to 3 (#18392) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-22 17:36:50 +08:00
Chlins Zhang
6590fe8eef
fix: register sweeper retain counts for purge audit log job (#18390) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-22 15:22:24 +08:00
Wang Yan
2f380495bf
revert subject id in the accessory (#18377) 
DO not replact id with digest and just add digest into the accessory table

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-22 10:58:30 +08:00
stonezdj(Daojun Zhang)
46fa91f866
Fix dangling state execution (#18272) 
Add max update hour and max dangling hour setting in config.yaml
  Fixes #17611

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-21 18:48:14 +08:00
Chlins Zhang
67d3f9add8
feat: support configurate the http client timeout for webhook job (#18382) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-21 11:54:10 +08:00
Chlins Zhang
f21b1481bb
refactor: refactor the old goroutine execution sweep (#18361) 
refactor: refactor the old goroutine execution sweep to global execution sweep job

1. Delete the old goroutine execution sweeper when create execution.(in the case of high concurrency can cause goroutine backlogs, affect the performance of core)
2. Introduce the new way to sweep executions, a global scheduled job will take the work.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-21 10:10:55 +08:00
Shijun Sun
2b3f178a50
Upgrade Golang packages (#18376) 
1. Upgrade golang.org/x/net to 0.7.0
2. Upgrade helm.sh/helm/v3 to 3.11.1

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-20 15:59:37 +08:00
dependabot[bot]
79c0a22ce8
Bump webpack from 5.74.0 to 5.76.0 in /src/portal/app-swagger-ui (#18352) 
Bumps [webpack](https://github.com/webpack/webpack) from 5.74.0 to 5.76.0.
- [Release notes](https://github.com/webpack/webpack/releases)
- [Commits](https://github.com/webpack/webpack/compare/v5.74.0...v5.76.0)

---
updated-dependencies:
- dependency-name: webpack
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-03-20 15:06:00 +08:00
Wang Yan
bb291aaa16
add middleware for artifact with subject (#18369) 
As for the distribution spec 1.1, it supports client to push an manifest with subject field. By leverging this fidle, harbor could build up the linkage between the subject artifact and it's accessories.

Signed-off-by: wang yan <wangyan@vmware.com>
 2023-03-19 20:09:41 +08:00
Shijun Sun
e086710173
Fix some UI issues (#18371) 
1. Fixes #17892
2. Redirect to default page when redirectUrl starts with /account/sign-in

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-17 18:52:23 +08:00
Daniel Jiang
bea8dece07
feat: upgrade golang to 1.20.1 (#18370) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Shengwen Yu <yshengwen@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-03-17 17:49:44 +08:00
Shijun Sun
339f5b106b
Make label filter editable for replication rule (#18357) 
1. Fixes #15825
2. Now, you can input labels or select them from the candidates

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-17 15:48:03 +08:00
MinerYang
e76aff6a0a
add external redis username config to support redis6 ACL (#18364) 
add external redis username o support redis6 ACL

Signed-off-by: yminer <yminer@vmware.com>
 2023-03-17 14:16:19 +08:00
Shijun Sun
53d86f872e
Support accessory recursion for artifact list (#18366) 
1. Update accessory UI to support recursion

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-17 13:01:24 +08:00
Shijun Sun
321d8a0885
Update UI packages (#18312) 
1. Update Angular packages to 15.2.1
2. Update swagger-ui to 4.17.1
3. Update Clarity to 15.0.1 and remove datepickerToggle property

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-17 12:14:16 +08:00
Thomas Coudert
5287c0e79d
Improve Portal french translation (#18289) 
* Remove useless translation values and fix variable name typo

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>

* Improve Portal French translation

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>

* Translate Portal CVE_EXPORT in french

Signed-off-by: Thomas Coudert <thomas.coudert@ovhcloud.com>
 2023-03-15 14:25:14 +08:00
Back Yu
fe236ecd2e
Support vpc and internal network (goharbor#17488) (#17489) 
Signed-off-by: Back Yu <yhfszb@gmail.com>
 2023-03-15 11:04:45 +08:00
Shijun Sun
1acba0c3bb
Add dynamic column support (#18331) 
1. Fixes #17815
2. Add dynamic column support for replication rule list  and artifact list

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-14 14:41:16 +08:00
Shijun Sun
a1d397842d
Improve webhook UI (#18325) 
1. Add text format for payload data
2. Delete payload_format for Slack

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-14 13:28:12 +08:00
Chlins Zhang
65e675d2e6
feat: integrate CloudEvents to webhook (#18322) 
Integrate CloudEvents as payload format for webhook.

Closes: #17748

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-14 10:44:25 +08:00
Wang Yan
9b61d34c4c
add referrers api (#18324) 
add referrers api

The define of referrers api in the upstream oci spec: https://github.com/opencontainers/distribution-spec/blob/v1.1.0-rc1/spec.md#listing-referrers

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-12 15:28:37 +08:00
stonezdj(Daojun Zhang)
ab636fe3da
Remove go routine to reloadSetting (#18318) 
Config is cached in redis
  Fixes #18189

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-11 15:45:50 +08:00
Shengwen YU
4efee54f07
feat: upgrade mockery version (#18332) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-03-11 08:16:11 +08:00
Shijun Sun
ec7c99c270
Add agent config for ng serve (#18323) 
1. Add agent setting for the proxy config
2. Add https-proxy-agent package

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-10 17:22:11 +08:00
stonezdj(Daojun Zhang)
e8e56fd31d
Check tag name for OCI spec (#18311) 
Verify tag name with OCI spec when creating tag

  Fixes #18073

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-10 10:40:37 +08:00
stonezdj(Daojun Zhang)
5c9ce836cf
Skip robot account for oidc_cli middleware (#18317) 
Fixes #15253

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-09 15:41:08 +08:00
Wang Yan
5a065d1cd8
fix robot account list project (#18304) 
Fixes #17636, to determine permissions for the project resource, the path should be /project instead of /project/project.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-09 14:16:18 +08:00
Wang Yan
295260b7a3
replace subject id with digest (#18278) 
Since it has to support push subject and accessories in either order, it has to replace digest with id

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-03-08 17:03:12 +08:00
Yang Jiao
fecee37439
Update robot account to skip NotFoundErr (#18321) 
Fix #18320

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
 2023-03-08 15:39:50 +08:00
hyeyoung-leee
2c287cf27a
Modified to check the expiration time of the allowlist when determining the vulnerability of an artifact (#18106) 
Signed-off-by: hyeyoung-lee <hyeyoung.lee@nhn.com>
 2023-03-08 11:25:40 +08:00
Shijun Sun
1238384428
Add logs column for worker datagrid (#18307) 
1. Related back-end PR #18261

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-07 19:58:39 +08:00
Shijun Sun
38d7eda1ad
Update UI for the deprecation of Artifact Hub (#18303) 
1. Update edit-registry page to enable the edition for Artifact Hub
2. Update edit-replication-rule page to enable the edition for rules contain Artifact Hub

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-07 18:12:08 +08:00
Shijun Sun
ba9078f463
Enhance webhook UI (#18291) 
1. Add execution list for a certain webhook policy
  2. Add task list for a certain execution

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-07 17:12:18 +08:00
stonezdj(Daojun Zhang)
5c0266e719
Get job log by job_id in worker (#18261) 
Get job by job_id in redis

  Get the last 10MB of data if it exceeds 10MB

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-06 13:19:10 +08:00
Shijun Sun
6f01d7480b
Add retry times for calling CVE data export execution list API (#18297) 
1.Fixes #17879
2.Add retry times to avoid endless API calls for CVE data export execution list API

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-03-03 14:44:36 +08:00
Chlins Zhang
90db04e92d
refactor: refact the webhook API and life process (#18255) 
refactor: refact the notification job API and life process

1. Introduce new APIs for webhook jobs management.
2. Refact legacy APIs for backforward compatible.
3. Migrate the webhook jobs process to unified execution/task framework.

Closes: #18210

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-03-03 10:17:47 +08:00
stonezdj(Daojun Zhang)
320c64e433
Sort user and usergroup by most match order (#18273) 
fixes #17859

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-03-01 10:11:21 +08:00
Shijun Sun
9973d99f3e
Remove chart api (#18265) 
* remove chart api from swagger

Delete the api path for chart in the swagger

Signed-off-by: Wang Yan <wangyan@vmware.com>

* Remove chart APIs
   1. Remove some chart-related steps for Dockerfile for portal  container
   2. Remove chart APIs for API center

Signed-off-by: AllForNothing <sshijun@vmware.com>

---------

Signed-off-by: Wang Yan <wangyan@vmware.com>
Signed-off-by: AllForNothing <sshijun@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2023-02-24 14:47:42 +08:00
Shijun Sun
a79c0ad496
Add next scheduled time for tag retention (#18223) 
1. Add next scheduled time UI
   2. Update font style

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-02-22 12:26:58 +08:00
Shijun Sun
c5640acd7b
Add scanner_skip_update_pulltime property for system setting (#18214) 
1. Related backend PR #17807

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-02-22 10:58:01 +08:00
Chlins Zhang
4141d77407
fix: remove noise log when core started (#18260) 
Fixes: #18126

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-02-21 17:38:42 +08:00
stonezdj(Daojun Zhang)
58054c0ce8
Change queue name for purge audit log and filter the old one (#18182) 
Fixes #18121
 Refactor job name with VendorType prefix, make sure job queue name and vendor type in execution and task are identical

Signed-off-by: stonezdj <daojunz@vmware.com>
 2023-02-20 16:03:22 +08:00
stonezdj(Daojun Zhang)
d03f0dcf2d
Skip to update pull time and pull count for scanner robot account (#17807) 
Add prefix for scanner robot account
   Fixes #14638

Signed-off-by: stonezdj <daojunz@vmware.com>

# Conflicts:
#	api/v2.0/swagger.yaml
#	src/common/const.go
#	src/lib/config/metadata/metadatalist.go
 2023-02-20 15:09:21 +08:00
Chlins Zhang
da1637e1d3
fix: resolve the oidc or ldap group user cannot export cve (#18219) 
Remove the project filter in the scan data export job as they have been
validated by API handler, fix the oidc or ldap group users cannot export
cve.

Fixes: #18112

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-02-20 14:22:27 +08:00
Shengwen YU
94dbc3fa8f
fix: add "next_scheduled_time" (#18102) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-02-17 17:54:53 +08:00
Wang Yan
738fde7d3b
remove chartmuseum backend (#18191) 
Harbor deprecates chartmuseum as of v2.8.0

Epic: https://github.com/goharbor/harbor/issues/17958

Discussion: https://github.com/goharbor/harbor/discussions/15057

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2023-02-16 18:11:05 +08:00
Shijun Sun
ec5afc3257
Display error message by defaul for event panel (#18226) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-02-16 10:30:21 +08:00
Chlins Zhang
47137605c9
fix: update the replication API handler (#18197) 
1. Check execution before stop replication execution.
2. Check execution before list replication tasks.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-02-14 13:11:27 +08:00
Shijun Sun
cece65ccf7
Translate English to Chinese for primary auth mode tooltip (#18196) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-02-13 12:12:17 +08:00
Fish-pro
2f04d4f810
chore: clean up no longer support linters for golang-lint (#18165) 
Clean up no longer support linters for golang-lint

Signed-off-by: Fish-pro <zechun.chen@daocloud.io>
 2023-02-10 16:27:37 +01:00
Shengwen YU
a4c95fa030
fix: reset user password (#18192) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-02-09 18:39:13 +08:00
Maksym Trofimenko
68fb01813e
Allow the Identity Provider to be the primary auth method in Harbor. (#17627) 
Allow the Identity Provider to be the primary auth method in Harbor

Signed-off-by: Maksym Trofimenko <maksym@container-registry.com>
 2023-02-08 18:11:08 +01:00
Shijun Sun
ff9dcd5483
Remove helm chart UI (#18099) 
1.Remove all helm chart v2 related code

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-02-08 16:47:03 +08:00
Shijun Sun
9d30955607
Support searching artifacts by specified tag name (#18175) 
1.Fixes #18082
  2.Update CSS

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-02-08 16:00:37 +08:00
Shijun Sun
fdf93470c5
Correct total count for schedule list datagrid (#18148) 
1.Fixes #18120

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-02-08 12:01:01 +08:00
Shengwen YU
62c033b6d3
fix retention/immutable API issue (#18158) 
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
 2023-02-06 14:42:15 +08:00
Caleb Lloyd
901cc17c67
aws auth use default creds when none are supplied (#17932) 
Signed-off-by: Caleb Lloyd <caleblloyd@gmail.com>
Co-authored-by: Vadim Bauer <vb@container-registry.com>
 2023-02-03 21:52:53 +01:00
Chlins Zhang
bfe4362a67
fix: remove the scan exports volume (#18107) 
1. Change the Export CVE temporary file directory to /tmp.
2. Remove the scan data export volume in Dockerfile and docker-compose
   yaml.

Fixes: #18067

Signed-off-by: chlins <chenyuzh@vmware.com>
 2023-01-31 17:30:47 +08:00
rongfu.leng
0fb076a09a
add match many version pattern test (#18092) 
Signed-off-by: lengrongfu <1275177125@qq.com>

Signed-off-by: lengrongfu <1275177125@qq.com>
 2023-01-16 16:40:19 +08:00
Shijun Sun
2ea53444e6
Add i18n support for Clarity components (#18076) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-01-11 10:29:05 +08:00
Noah Tang
a9a67462dc
add job status unit test (#18057) 
Signed-off-by: coderth <coderth@outlook.com>

Signed-off-by: coderth <coderth@outlook.com>
 2023-01-10 13:28:28 +08:00
Shijun Sun
a86740e82a
Update datePicker component (#18070) 
1.Fix date validator
2.Add i18n support

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-01-06 11:36:01 +08:00
Shijun Sun
2361ae161f
Upgrade Angular and Clarity to the latest version (#18059) 
Upgrade Angular and Clarity
  1.Upgrade related libraries
  2.Fix breaking changes

Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2023-01-05 10:42:59 +08:00
MinerYang
ba5baca769
bump up helm/v3/pkg to v3.10.3 on main (#18050) 
Signed-off-by: yminer <yminer@vmware.com>

Signed-off-by: yminer <yminer@vmware.com>
 2023-01-04 15:42:32 +08:00
Aleksandr Chebotov
452ae168cc
fix purge info typo (#18023) 
Signed-off-by: Aleksandr Chebotov <alk.chebotov@gmail.com>
 2023-01-03 13:48:14 +08:00
Shijun Sun
d87d906c84
Switch listUsers to searchUsers for adding project member (#18022) 
Fixes #18000

Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-12-23 16:09:22 +08:00
Kenton Groombridge
76757a5334
i18n: fix password+secret limit tooltips (#17916) 
Some translations specify the (older) limit of 20 characters for
passwords and secrets. Update these to specify a limit of 128
characters.

Signed-off-by: Kenton Groombridge <me@concord.sh>

Signed-off-by: Kenton Groombridge <me@concord.sh>
 2022-12-21 10:52:06 +08:00
Christian Zenker
9674a51b83
fix: Don't supress redis error messages to make debugging easier (#17986) 
Signed-off-by: Christian Zenker <christian.zenker@aoe.com>

Signed-off-by: Christian Zenker <christian.zenker@aoe.com>
 2022-12-15 10:42:16 +08:00
Chlins Zhang
b0a30b9a2f
fix: fix the time duration type duplicated parse for config (#17981) 
Fix the time duration type duplicated parse for config, maintaining the idempotency of set and get operations.

Signed-off-by: chlins <chenyuzh@vmware.com>

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-12-13 18:22:41 +08:00
Shijun Sun
86e34c8e59
Fix some UI issues (#17964) 
1.Fixes #17874
   2.Correct some i18n items

Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-12-09 15:03:30 +08:00
stonezdj(Daojun Zhang)
ceb130e617
Avoid internal error in the UI when reset a schedule (#17946) 
fixes #17926

Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-12-08 20:43:44 +08:00
stonezdj(Daojun Zhang)
c4a58433cf
Update the log information in proxy cache (#17936) 
fixes #17933

Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-12-08 13:50:37 +08:00
Wang Yan
d83cee083a
remove artifact_blob with aritfact deletion (#17913) 
fixes #17857

It needs to clean the artifact_blob records on artifact deletion in GC

Signed-off-by: Wang Yan <wangyan@vmware.com>

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2022-12-07 13:37:10 +08:00
Iceber Gu
a90181e312
fix the setting of data slice length for tablewriter (#17918) 
Signed-off-by: Iceber Gu <wei.cai-nat@daocloud.io>
 2022-12-07 13:19:08 +08:00
little_an
8cc16de180
fix dragonfly response when p2p preheat (#15916) 
* fix dragonfly response when p2p preheat

Signed-off-by: anyiwei <anyiwei@didichuxing.com>
 2022-12-06 16:12:21 +08:00
Iceber Gu
7dc452ccab
controller/robot: use global regexp vars (#17915) 
Signed-off-by: Iceber Gu <wei.cai-nat@daocloud.io>

Signed-off-by: Iceber Gu <wei.cai-nat@daocloud.io>
 2022-12-06 15:59:37 +08:00
MinerYang
e558befc8e
bump up golang.org/x/net to v0.2.0 (#17910) 
Signed-off-by: yminer <yminer@vmware.com>
 2022-12-06 03:59:36 +08:00
Chlins Zhang
287f334327
fix: align some configuration api fields validation with frontend (#17903) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-12-05 15:52:41 +08:00
stonezdj(Daojun Zhang)
2f5827a42e
Remove unused go-sql-driver/mysql (#17895) 
Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-12-02 16:49:28 +08:00
Wang Yan
277c78e212
update system artifact schedult timeout (#17902) 
fixes #17887
enhance the timeout to 5m to avoid system artifact failed to schedule in the helm base installation.

Signed-off-by: Wang Yan <wangyan@vmware.com>

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2022-12-02 14:30:05 +08:00
Shijun Sun
5f1dff32c2
Change inputs type from text to number (#17897) 
1.Fixes #17890
   2.Update isDBAuth function

Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-12-02 12:51:38 +08:00
stonezdj(Daojun Zhang)
64c03e8679
Update the execution status after tasks stopped (#17875) 
Fixes #17862

Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-12-01 21:17:35 +08:00
Shijun Sun
491dcf7d9b
Update jobservice dashboard UI (#17894) 
1.Fixes #17855, #17874 and #17863
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-12-01 17:01:59 +08:00
Jianwei Guo
cb11540a14
add parameters for PostgreSQL (#16641) 
Signed-off-by: sayaoailun <guojianwei007@126.com>
 2022-11-30 19:08:08 +08:00
Shijun Sun
927a055aa9
Update i18n for group filter and schedule list (#17884) 
Fixes #17868 and #17853

Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-30 14:35:01 +08:00
stonezdj(Daojun Zhang)
402363d50b
Remove job parameters and schedule extra attribute (#17878) 
Remove job parameters from job

  Remove extra attribute and cron type from schedule
  fixes #17866

Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-11-28 17:45:26 +08:00
stonezdj(Daojun Zhang)
80999f28ee
Keep CheckInAt time empty when it is empty (#17877) 
Fixes #17860

Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-11-28 14:02:30 +08:00
MinerYang
f97aedfb5c
Increase golangci-lint timeout value (#17841) 
increase golangci-lint timeout value

Signed-off-by: yminer <yminer@vmware.com>

Signed-off-by: yminer <yminer@vmware.com>
 2022-11-25 11:10:21 +08:00
stonezdj(Daojun Zhang)
619747fc68
Stop Pending Job cannot update status (#17842) 
Convert the redis range result into struct and extract job id from it
  Add more log when get redis config fails

Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-11-24 20:29:50 +08:00
Shijun Sun
d079034b23
Update schedule list (#17851) 
1.Add Cron and Cron Type columns

Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-24 18:51:40 +08:00
Wang Yan
18a3373725
bump beego (#17801) 
* bump beego

upgrade beego version from v1.10.12 to v2.0.5

1, beego v2 vserver/web refactor
2, beego v2 context refactor
3, beego v2 session refactor
4, beego v2 cache refactor
5, beego v2 orm refactor

Signed-off-by: MinerYang <yminer@vmware.com>
 2022-11-24 18:07:42 +08:00
stonezdj(Daojun Zhang)
f8628258bc
Add Cron, CronType and Update Time for schedule (#17844) 
Remove create time because update time is added

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-11-24 10:38:52 +08:00
Shijun Sun
fcf0e2014f
Update English text for job service UI (#17832) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-23 18:19:45 +08:00
sluetze
a826720cc9
Updated German Translation (#17829) 2022-11-21 14:43:26 +01:00
stonezdj(Daojun Zhang)
4b7d45513e
Fix issue related to redhat registry proxy cache (#17789) 
fixes #16495

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-11-18 17:17:39 +08:00
Shijun Sun
ea812c9f16
Add Jobservice UI (#17722) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-18 14:39:26 +08:00
Chlins Zhang
321a9abfb3
fix: skip to push system artifact for empty CSV file (#17816) 
1. Skip to push system artifact to the distribution when the exported CSV file is empty.
2. Add status message for cve export execution.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-11-18 14:16:36 +08:00
MinerYang
62223bd36d
update golangci-lint for golang1.19 (#17817) 
update golaci-lint for golang1.19

Signed-off-by: yminer <yminer@vmware.com>

update ci version to v1.50.1
 2022-11-18 11:40:01 +08:00
Shijun Sun
cbfffce413
Update cve export UI (#17814) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-18 10:37:50 +08:00
stonezdj(Daojun Zhang)
57aff88eb5
Add REST API to list job queue status, pause/resume job queue and list schedulers (#17707) 
Add queue manager and redis client
  Update scheduler to add count and list

Signed-off-by: stonezdj <daojunz@vmware.com>

Signed-off-by: stonezdj <daojunz@vmware.com>
 2022-11-17 20:12:07 +08:00
yanggang
0f4e2daf4c
Replaced io/ioutil with "os / io" package. (#17792) 
Signed-off-by: yanggang <gang.yang@daocloud.io>

update typo

Signed-off-by: yminer <yminer@vmware.com>

Signed-off-by: yminer <yminer@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
 2022-11-17 10:02:29 +08:00
stonezdj(Daojun Zhang)
ea27197a82
Sort group search result by most match order (#17708) 
fixes #17535

Signed-off-by: stonezdj <stonezdj@gmail.com>

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2022-11-15 20:38:44 +08:00
Shijun Sun
e86e9aa529
Migrate policy API calls to generated service (#17782) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-15 17:26:20 +08:00
Shijun Sun
f2212eef25
Add session timeout input (#17769) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-15 11:39:48 +08:00
Chlins Zhang
9c9aa58d6a
feat: support customize session timeout (#17767) 
Add configuration session_timeout for API, then user can customize the
timeout from system config page or API. The timeout is 60 minutes by
default.

Signed-off-by: chlins <chenyuzh@vmware.com>

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-11-15 11:30:01 +08:00
Chlins Zhang
7f00a77d99
fix: pre check notification enable for artifact webhook (#17779) 
Check the notification enable before in the artifact webhook handler,
avoid additional db query cost for notification_policy.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-11-15 09:54:36 +08:00
stonezdj(Daojun Zhang)
a47e175056
Remove email configuration (#17712) 
Email related settings are deprecated
   Remove email ping API
   Fixes #17683

Signed-off-by: stonezdj <stonezdj@gmail.com>

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2022-11-14 15:03:49 +08:00
Maksym Trofimenko
6b46b8bf26
fix permission denied error for non existing projects (#17586) (#17619) 
Signed-off-by: Maksym Trofimenko <maksym@container-registry.com>
 2022-11-14 12:01:20 +08:00
Shijun Sun
40ba15ca5a
Fix permission issue for edit button of repo info (#17775) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-11 10:14:41 +08:00
stonezdj(Daojun Zhang)
cc69b1e951
Add OIDC group filter (#17736) 
Filter out the OIDC group which doesn't match the regular expression
  Fixes #17130

Signed-off-by: stonezdj <stonezdj@gmail.com>

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2022-11-11 09:55:11 +08:00
Shijun Sun
a21ef51ce4
Add OIDC group filter input (#17752) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-11 09:50:02 +08:00
Chlins Zhang
77df4d92fd
feat: support customize registry http client timeout (#17768) 
Support override the registry http client timeout from env `REGISTRY_HTTP_CLIENT_TIMEOUT` (in minutes), the timeout is 30 minutes by default.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-11-09 17:20:47 +08:00
Shijun Sun
87005f32d9
Improve css for tags column (#17734) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-07 16:49:41 +08:00
erismaster
ec7717e23b
Add JFrog Artifactory As Supported Proxy-Cache Registry Source (#17738) 
Add JFrog Artifactory As Supported Proxy-Cache

Enables the support of JFrog Artifactory as a source for proxy-cache. I
have tested this with a local build and was able to proxy images just
fine.

Signed-off-by: Derrik Campau <dcampau@vmware.com>

Signed-off-by: Derrik Campau <dcampau@vmware.com>
 2022-11-04 12:50:34 +08:00
Wang Yan
4fb0a19efb
add cli randomly for empty update (#17740) 
give an random cli secret when client gives empty update.

Signed-off-by: Wang Yan <wangyan@vmware.com>

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2022-11-03 21:04:29 +08:00
Shijun Sun
10cb2fd2c7
Update the way for generating new cli secret (#17744) 
Update the way for refreshing cli-secret

Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-03 21:04:04 +08:00
Shijun Sun
93ac2e8111
Remove email config page (#17711) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-03 14:48:06 +08:00
stonezdj(Daojun Zhang)
39ca918ffe
Add jobservice monitoring api list pool, worker and stop running task (#17658) 
Add REST API to list job pool, worker, stop running task

  Add jobservice handler to retrieve configuration
  Add RBAC for jobservice monitoring dashboard
  Add REST API to list pool, worker and stop running task

Signed-off-by: stonezdj <stonezdj@gmail.com>

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2022-11-03 10:47:40 +08:00
Shijun Sun
4206ec8ab1
Add triggers and filters check for target changing under push mode (#17731) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-02 15:34:34 +08:00
MinerYang
1f05dcdcda
bump up golang.org/x/crypto to v0.1.0 (#17691) 
Signed-off-by: yminer <yminer@vmware.com>

Signed-off-by: yminer <yminer@vmware.com>
 2022-11-02 14:55:38 +08:00
Chlins Zhang
bf4cfe9e1e
fix: add human friendly message when export cve job failure (#17726) 
Add human friendly when export CVE in the condition of empty CSV file,
because this file will be stored as system artifact and pushed to
distribution, but it will leads to error when push empty blob to S3
storage driver.

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-11-01 15:04:07 +08:00
Shijun Sun
0edc01a395
Add copy_by-chunk checkbox for replication rule (#17617) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-11-01 12:33:40 +08:00
Chlins Zhang
c330b8c63a
feat: introduce the copy by chunk for replication (#17602) 
1. Add sql migration to alter replication policy table
2. Implement the PullBlobChunk and PushBlobChunk for the underlying v2 registry client
3. Update image transfer logic to support copy by chunk
4. Update the replication policy API handler

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-11-01 11:19:17 +08:00
MinerYang
b193f3f717
bump up github.com/prometheus/client_golang to v1.13.0 (#17688) 
Signed-off-by: yminer <yminer@vmware.com>

update
 2022-10-31 16:46:50 +08:00
Chlins Zhang
1a1a6d2fd2
feat: log completion message when database migrated (#17684) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-10-31 10:45:05 +08:00
stonezdj(Daojun Zhang)
3050e856d9
Add check when adding project member (#17701) 
Signed-off-by: stonezdj <stonezdj@gmail.com>

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2022-10-28 15:06:27 +08:00
MinerYang
6f4d84ecdb
bump up golang.org/x/text to v0.4.0 (#17689) 
bump up golang.org/x/text tp v0.4.0

Signed-off-by: yminer <yminer@vmware.com>

Signed-off-by: yminer <yminer@vmware.com>
 2022-10-27 13:19:57 +08:00
MinerYang
c5417a2d00
bump up helm.sh/helm/v3 (#17698) 
bump helm.sh/helm/v3 to achieve the purpose of bump up github.com/docker/cli indirectly

Signed-off-by: yminer <yminer@vmware.com>

Signed-off-by: yminer <yminer@vmware.com>
 2022-10-27 13:19:09 +08:00
Eng Zer Jun
cd0fa06a32
test: use T.Setenv to set env vars in tests (#17670) 
This commit replaces `os.Setenv` with `t.Setenv` in tests. The
environment variable is automatically restored to its original value
when the test and all its subtests complete.

Reference: https://pkg.go.dev/testing#T.Setenv
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
 2022-10-25 10:56:26 +08:00
Gaius
81f618fb9a
feat: optimize return value in pkg modifier (#17655) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2022-10-21 15:38:39 +08:00
Maksym Trofimenko
486bdb6b99
Fix redirect url redirect_url when OIDC auth mode is enabled (#17628) 
* fix redirect url for OIDC auth mode

Signed-off-by: Maksym Trofimenko <maksym@container-registry.com>

* portal lint_fix

Signed-off-by: mtrofimenko <gtpoxa@gmail.com>

* make linter happy

Signed-off-by: mtrofimenko <gtpoxa@gmail.com>

Signed-off-by: Maksym Trofimenko <maksym@container-registry.com>
Signed-off-by: mtrofimenko <gtpoxa@gmail.com>
Co-authored-by: Maksym Trofimenko <maksym@container-registry.com>
 2022-10-21 14:38:13 +08:00
Shijun Sun
c4146667f1
Remove validator for username claim input (#17663) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-10-20 15:46:03 +08:00
Vincent Ni
9c0275deb6
Fix ecr authorization token issue (#17645) 
Signed-off-by: Vincent Ni <kangqini@amazon.com>
 2022-10-18 11:09:58 +08:00
stonezdj(Daojun Zhang)
b6bdb4b57f
Add default project when pulling from dockerhub without project name (#17537) 
Check project is default project format in dockerhub
 Redirect blob/manifest request to default url
 Fixes #12719

Signed-off-by: stonezdj <stonezdj@gmail.com>

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2022-10-17 17:37:44 +08:00
Gaius
25a42af277
test: add GetRedisURL to tests redis pkg and fix hardcoded redis url (#17581) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2022-10-17 17:21:37 +08:00
Vincent Ni
805a36e7f0
Fix Replication to Cross-account AWS ECR (#17583) 
Replication to Cross-account AWS ECR
 2022-09-30 09:07:47 +02:00
Shijun Sun
cf5197246a
Fix message processing issue (#17609) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-09-29 11:12:11 +08:00
Shijun Sun
303133f695
Improve auth check guard service (#17605) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-09-28 17:05:25 +08:00
Shijun Sun
90fe39684b
Refresh config every time entering the configuration page (#17600) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-09-27 16:04:02 +08:00
MinerYang
83bc24f6c1
Bump up golang version to v1.19 (#17588) 
Signed-off-by: yminer <yminer@vmware.com>

update
 2022-09-22 17:38:26 +08:00
Shijun Sun
1f908088b7
Simplify proxy config (#17548) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-09-22 11:40:04 +08:00
stonezdj(Daojun Zhang)
b08b5fe617
Add check on the audit log forward and skip audit log database (#17575) 
fixes #17524
Signed-off-by: stonezdj <stonezdj@gmail.com>
 2022-09-21 15:24:57 +08:00
Shijun Sun
3d8959be49
Refactor artifact-list component (#17577) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-09-20 17:16:16 +08:00
stonezdj(Daojun Zhang)
b6c978c7f7
Change ldap.Search to ldap.SearchWithPaging (#17534) 
fixes #16390

Signed-off-by: stonezdj <stonezdj@gmail.com>

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2022-09-19 11:04:54 +08:00
Wang Yan
848167c4e0
bump dependencies (#17549) 
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
- dependency-name: golang.org/x/net
- dependency-name: helm.sh/helm/v3

Signed-off-by: Wang Yan <wangyan@vmware.com>

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2022-09-15 16:50:16 +08:00
Vincent Ni
a3d96000f5
Fix cross account issue (#17533) 
Signed-off-by: Vincent Ni <kangqini@amazon.com>
 2022-09-15 14:25:41 +08:00
Shijun Sun
13b3233faf
Refactor artifact-list-tab component (#17542) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-09-15 11:37:36 +08:00
Shijun Sun
acf68d3533
Fix css issue for resource type filter (#17529) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-09-13 16:57:25 +08:00
Chlins Zhang
9573cd7753
fix: handle the break change for parse external sentinel redis url (#17501) 
Handle the ParseSentinelURL to resolve an incompatible modification that does not recognize the default redis database.

Closes: #17483

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-09-07 11:29:43 +08:00
Shijun Sun
7bd6c9480d
Correct i18n key for zh-cn-lang.json (#17457) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-08-29 11:33:00 +08:00
Shijun Sun
1ce5d98efe
Remove preload for theme css files (#17468) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-08-29 11:32:41 +08:00
Shijun Sun
c3e98c8848
Change title for Swagger UI (#17451) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-08-24 16:00:26 +08:00
Shijun Sun
006f495c82
Add WASM filter for artifacts list (#17447) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-08-23 17:00:34 +08:00
Shijun Sun
83bce02e61
Refactor swagger ui (#17428) 
Signed-off-by: AllForNothing <sshijun@vmware.com>

Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-08-23 12:03:45 +08:00
Chenyu Zhang
31a3c6d18c
fix: validate the existence of project for export cve api (#17437) 
Validate the existence of the project for export CVE API handler, return
not found error if the project is not exist.

Closes: #17430

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-08-22 15:44:57 +08:00
Chenyu Zhang
5d7a549620
upgrade: bump up mockery to v2.14.0 (#17415) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-08-22 14:21:13 +08:00
Matt Busche
548b27a0c6
Update to latest version of angular (#17303) 
* Update to the latest version of angular

Signed-off-by: Matt Busche <mrbusche@gmail.com>
 2022-08-17 11:30:48 +08:00
Chenyu Zhang
24d60eb119
enhancement: add error log for create task (#17397) 
Signed-off-by: chlins <chenyuzh@vmware.com>

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-08-16 11:35:05 +08:00
Shijun Sun
4521189e5e
Improve unit test for sub-accessories component (#17372) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-08-10 16:20:55 +08:00
Shijun Sun
423647ea33
Improve input validator for copy-component (#17310) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-08-09 12:15:17 +08:00
Shijun Sun
893cb0a655
Fix ui issues found in testing-day-round-2 (#17357) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-08-09 12:14:53 +08:00
MinerYang
daf0874ed5
project userid not found log level into debug (#17343) 
Signed-off-by: yminer <yminer@vmware.com>
 2022-08-08 14:20:13 +08:00
Chenyu Zhang
1e13999fff
fix: validate export cve request params (#17341) 
1. Validate export cve request params in the API handler
2. Trim space for request in the scan export job

Closes: #17326

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-08-08 11:07:05 +08:00
Chenyu Zhang
49d73fa57d
fix: export cve for image manifest list (#17333) 
1. Fix export cve for image manifest list
2. Remove row_id column in csv file
3. Update cve execution swagger API description

Closes: #17331,#17330,#17335,#17334

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-08-05 20:07:02 +08:00
prahaladdarkin
c776ea8bfe
Export CVE data Score column empty values (#17321) 
Closes: https://github.com/goharbor/harbor/issues/17189

Signed-off-by: prahaladdarkin <prahaladd@vmware.com>
 2022-08-05 10:03:42 +08:00
Chenyu Zhang
49999ab1c0
fix: replication webhook lost when src namespace different with dest (#17312) 
Fix the replication webhook notification lost when the rule is
pull-based and src namespace different with dest.

Closes: #17298

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-08-04 15:10:19 +08:00
Chenyu Zhang
70a95a9696
fix: reduce the high db cpu usage for tag retention (#17296) 
1. Add two indexes to database migrations.
2. Skip refresh quota in middleware for requests from jobservice.
3. Refresh quota by self in the end of tag retention job.

Closes: #14708

Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-08-04 10:08:02 +08:00
Wang Yan
914d9a5526
fix copy artifact accessory quota issue (#17293) 
It needs to request quota for accessory on copying artifact.

Signed-off-by: wang yan <wangyan@vmware.com>
 2022-08-03 20:02:20 +08:00
lengrongfu
dac3c7b31d
fix: distribution v2.8.0 tag does not match checksum (#17306) 
Signed-off-by: lengrongfu <1275177125@qq.com>
 2022-08-03 17:43:37 +08:00
Wang Yan
ebab99613f
update session log level (#17300) 
To avoid too much noise in the core log, udpate the level to debug.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2022-08-03 13:51:26 +08:00
MinerYang
722d1a19ea
update image extra attributes author in labels (#17291) 
update image extra attributes author

Signed-off-by: yminer <yminer@vmware.com>

adding spec comment

Signed-off-by: yminer <yminer@vmware.com>
 2022-08-03 11:50:54 +08:00
stonezdj(Daojun Zhang)
66d34c8e0c
Return time.Time{} when cron string is empty (#17289) 
change log level to debug to avoid noise

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2022-08-02 15:18:25 +08:00
Shijun Sun
b4f2f170b4
Upgrade Angular dev-tool package (#17287) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-08-01 18:10:34 +08:00
MinerYang
1296e7ebf0
Enable staticcheck (#17286) 
enable golangci-lint staticcheck

enable staticcheck in golangci-lint

Signed-off-by: yminer <yminer@vmware.com>
 2022-08-01 16:58:51 +08:00
Adam
bf741ad381
feature: Use RegisteredClaims instead of deprecated staruct StandardClaims (#16206) 
Signed-off-by: wujw39640 <wujw39640@hundsun.com>
 2022-08-01 10:23:47 +08:00
Chenyu Zhang
bbc7282c46
upgrade: bump up beego to 1.12.11 (#17277) 
Signed-off-by: chlins <chenyuzh@vmware.com>
 2022-07-31 16:23:28 +08:00
Thomas Maroschik
0559ce7e28
fix: oidc token is not respected in /service/token endpoint (#16442) 
Signed-off-by: Thomas Maroschik <tmaroschik@dfau.de>
 2022-07-30 13:01:51 +02:00
Shijun Sun
455ebf51fc
Fix null pointer issue for creating reolication rule (#17274) 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2022-07-30 17:17:10 +08:00