Wang Yan
74dfc905ec
remove the redundant data from table artifact_blob ( #17937 )
...
use sql in the migration process to delete all the useless data of table artifact_blob
Signed-off-by: Wang Yan <wangyan@vmware.com>
Signed-off-by: Wang Yan <wangyan@vmware.com>
2022-12-13 15:32:57 +08:00
Jianwei Guo
cb11540a14
add parameters for PostgreSQL ( #16641 )
...
Signed-off-by: sayaoailun <guojianwei007@126.com>
2022-11-30 19:08:08 +08:00
MinerYang
9ae35dbc50
add migration script for 2.7 ( #17838 )
...
add migration script for 2.7
Signed-off-by: yminer <yminer@vmware.com>
2022-11-23 17:49:55 +08:00
stonezdj(Daojun Zhang)
57aff88eb5
Add REST API to list job queue status, pause/resume job queue and list schedulers ( #17707 )
...
Add queue manager and redis client
Update scheduler to add count and list
Signed-off-by: stonezdj <daojunz@vmware.com>
Signed-off-by: stonezdj <daojunz@vmware.com>
2022-11-17 20:12:07 +08:00
MinerYang
f20a2e433f
bump up golang to 1.19.3 ( #17751 )
...
Signed-off-by: yminer <yminer@vmware.com>
Signed-off-by: yminer <yminer@vmware.com>
2022-11-04 16:17:11 +08:00
erismaster
ec7717e23b
Add JFrog Artifactory As Supported Proxy-Cache Registry Source ( #17738 )
...
Add JFrog Artifactory As Supported Proxy-Cache
Enables the support of JFrog Artifactory as a source for proxy-cache. I
have tested this with a local build and was able to proxy images just
fine.
Signed-off-by: Derrik Campau <dcampau@vmware.com>
Signed-off-by: Derrik Campau <dcampau@vmware.com>
2022-11-04 12:50:34 +08:00
Chlins Zhang
e81067badb
fix: cherry pick 262 sql for migrations ( #17735 )
...
Signed-off-by: chlins <chenyuzh@vmware.com>
2022-11-03 10:05:46 +08:00
Chlins Zhang
c330b8c63a
feat: introduce the copy by chunk for replication ( #17602 )
...
1. Add sql migration to alter replication policy table
2. Implement the PullBlobChunk and PushBlobChunk for the underlying v2 registry client
3. Update image transfer logic to support copy by chunk
4. Update the replication policy API handler
Signed-off-by: chlins <chenyuzh@vmware.com>
2022-11-01 11:19:17 +08:00
MinerYang
6b8cdc03c1
bump up golang to 1.19.2 ( #17694 )
...
Signed-off-by: yminer <yminer@vmware.com>
Signed-off-by: yminer <yminer@vmware.com>
2022-10-26 20:28:19 +08:00
Shengwen YU
0acfbdc7a1
feat: bump TRIVYVERSION to v0.32.1 and bump TRIVYADAPTERVERSION to v0.30.2 ( #17681 )
...
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
2022-10-25 14:26:53 +08:00
MinerYang
83bc24f6c1
Bump up golang version to v1.19 ( #17588 )
...
Signed-off-by: yminer <yminer@vmware.com>
update
2022-09-22 17:38:26 +08:00
Yang Jiao
b44c9d01dd
Drop build postgresql 9.6 ( #17458 )
...
Drop pg9.6, will not support upgrading from pg9.6 to pg13, if you use pg9.6 you can upgrade to 2.5 and upgrade to 2.7
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-09-21 17:59:25 +08:00
MinerYang
306e780590
Add autoescape parameter for 2.5 & 2.6 jinja ( #17439 )
...
Signed-off-by: yminer <yminer@vmware.com>
update
2022-08-29 10:22:33 +08:00
Yang Jiao
1ea2ce6134
Update portal-base and nginx-base Dockerfile.base ( #17442 )
...
Installing nginx 1.22 creates the nginx group and nginx user, so instead
of creating them again, modify them.
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-08-24 14:48:09 +08:00
Shijun Sun
83bce02e61
Refactor swagger ui ( #17428 )
...
Signed-off-by: AllForNothing <sshijun@vmware.com>
Signed-off-by: AllForNothing <sshijun@vmware.com>
2022-08-23 12:03:45 +08:00
Soumik Majumder
861ca553df
Add autoescape parameter to jinja environments ( #15770 )
...
Signed-off-by: Soumik Majumder <soumikm@vmware.com>
Signed-off-by: Soumik Majumder <soumikm@vmware.com>
2022-08-23 11:02:16 +08:00
MinerYang
a272158023
add deprecation msg for chartmsuem and notary ( #17398 )
...
Signed-off-by: yminer <yminer@vmware.com>
adjust msg
adjust typo
adjust
2022-08-17 09:30:15 +08:00
MinerYang
bd102fbf7d
_version:2.6.0 correction in migration yml jinja ( #17328 )
...
Signed-off-by: yminer <yminer@vmware.com>
2022-08-05 16:54:16 +08:00
Chenyu Zhang
41105b5191
docs: add helpful description for cache layer configurations ( #17317 )
...
docs: add helpful description for cache layer configurations in harbor.yml.tmpl
Signed-off-by: chlins <chenyuzh@vmware.com>
2022-08-04 15:14:45 +08:00
Chenyu Zhang
70a95a9696
fix: reduce the high db cpu usage for tag retention ( #17296 )
...
1. Add two indexes to database migrations.
2. Skip refresh quota in middleware for requests from jobservice.
3. Refresh quota by self in the end of tag retention job.
Closes : #14708
Signed-off-by: chlins <chenyuzh@vmware.com>
2022-08-04 10:08:02 +08:00
MinerYang
0fbff49eb0
bumpup golang to v1.18.5 ( #17307 )
...
Signed-off-by: yminer <yminer@vmware.com>
2022-08-03 17:44:03 +08:00
MinerYang
bd1d441b01
bumpup golang version to v1.18.4 ( #17257 )
...
Signed-off-by: yminer <yminer@vmware.com>
2022-07-29 09:43:01 +08:00
Wang Yan
ef8b8f0be7
resolve the cve export volumn permission ( #17157 )
...
See the right uid and gid for the scandata_exports in the prepare
Signed-off-by: Wang Yan <wangyan@vmware.com>
2022-07-12 14:52:18 +08:00
prahaladdarkin
130452111b
Vulnerability scan data export functionality ( #15998 )
...
Vulnerability Scan Data (CVE) Export Functionality
Proposal - goharbor/community#174
Closes - https://github.com/goharbor/harbor/issues/17150
Changes:
* CVE Data export to CSV with filtering support.
* Implement CSV data export job for creating CSVs
* APIs to trigger CSV export job executions
Signed-off-by: prahaladdarkin <prahaladd@vmware.com>
2022-07-11 16:35:04 +08:00
Chenyu Zhang
41d10d571c
fix: repair execution status when it inconsistent ( #17128 )
...
Add migrations sql to repair the execution status when it does not
consistent with task status.
Closes : #17114
Signed-off-by: chlins <chenyuzh@vmware.com>
2022-07-06 17:02:03 +08:00
Chenyu Zhang
1a1ce634cc
Fix the process of cache layer ( #17010 )
...
fix: fix cache layer issues (#16995,#16997,#16996,#17038)
1. Load config and initialize cache layer in jobservice(for GC)
2. Cache artifact by digest the key should contains repository name
3. Repository cache cleanup error when update
4. Skip save cache when request ctx in transaction
Signed-off-by: chlins <chenyuzh@vmware.com>
2022-07-06 16:11:53 +08:00
MinerYang
8ba6a2bede
Add migration script for Harbor 2.6 ( #17116 )
...
add migration script for Harbor 2.6
Signed-off-by: yminer <yminer@vmware.com>
2022-07-06 14:08:24 +08:00
stonezdj(Daojun Zhang)
8115484f32
Create index for performance ( #17022 )
...
Add index to avoid full table scan
Signed-off-by: stonezdj <stonezdj@gmail.com>
2022-07-04 14:38:05 +08:00
Yang Jiao
77d28105bc
Upgrade pipenv to 2022.1.8 ( #17093 )
...
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-28 23:40:48 +08:00
MinerYang
b11970ac3c
update install htpasswd in prepare dockerfile ( #17056 )
...
update install htpasswd in prepare dockerfle
Signed-off-by: yminer <yminer@vmware.com>
2022-06-23 16:31:37 +08:00
Chenyu Zhang
0cf036e73a
migrate: add db index on artifact repository name ( #17053 )
...
Signed-off-by: chlins <chenyuzh@vmware.com>
2022-06-22 14:34:40 +08:00
MinerYang
541fbe784f
update support for docker compose v2 ( #17039 )
...
updte supportt for docker compose v2
Signed-off-by: yminer <yminer@vmware.com>
adjust install.sh
Signed-off-by: yminer <yminer@vmware.com>
2022-06-21 16:55:07 +08:00
Chenyu Zhang
5de1a62002
migrate: add db index on artifact repository name ( #17035 )
...
Signed-off-by: chlins <chenyuzh@vmware.com>
2022-06-20 16:01:04 +08:00
MinerYang
b8a71ac348
bump up golang version to v1.18.3 ( #16957 )
...
Signed-off-by: yminer <yminer@vmware.com>
update ci/ut_install.sh
Signed-off-by: yminer <yminer@vmware.com>
2022-06-08 17:56:14 +08:00
Chenyu Zhang
7ecd4a3f29
fix(prepare): validate expire hours when enable cache ( #16949 ) ( #16953 )
...
Signed-off-by: chlins <chenyuzh@vmware.com>
2022-06-07 13:21:47 +08:00
Wilmar den Ouden
79600f3fee
feat: enabled Github GHCR as proxy cache ( #16834 )
...
Signed-off-by: wilmardo <info@wilmardenouden.nl>
2022-06-06 15:36:16 +08:00
Franz Nemeth
7c2e591c26
fix: add patch for registry layers larger than 10G with S3 backend ( #16322 )
...
add patch for registry layers larger than 10G with S3 backend
Signed-off-by: Franz Nemeth <franz.nemeth@dynatrace.com>
2022-06-02 16:51:29 +02:00
MinerYang
1db7d6375a
support docker compose v2 ( #16919 )
...
Signed-off-by: yminer <yminer@vmmware.com>
Co-authored-by: yminer <yminer@vmmware.com>
2022-05-30 15:19:01 +08:00
Mac Chaffee
ecc8c59101
Use exec in registryctl so signals are passed properly ( #16642 )
...
Signed-off-by: Mac Chaffee <machaffe@renci.org>
2022-05-25 14:11:31 +08:00
prahaladdarkin
27ec871185
System Artifact Manager database schema creation, model definitons, and tests ( #16678 )
...
Closes:
https://github.com/goharbor/harbor/issues/16540
https://github.com/goharbor/harbor/issues/16541
https://github.com/goharbor/harbor/issues/16542
Signed-off-by: prahaladdarkin <prahaladd@vmware.com>
2022-05-09 17:32:57 +08:00
Shengwen Yu
3e8bf9faed
fix: registry/redis.patch & registry/builder
...
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
2022-04-29 08:51:49 +08:00
MinerYang
615a4cbb52
install only htpasswd binary from photon package httpd ( #16771 )
...
Signed-off-by: yminer <yminer@vmmware.com>
cpio -u
Signed-off-by: yminer <yminer@vmmware.com>
Co-authored-by: yminer <yminer@vmmware.com>
2022-04-28 13:20:03 +08:00
chlins
8c223135e7
feat: add cache layer for artifact ( #16739 )
...
Implement cache layer for resource artifact and define common
cache manager and workflow. Also add cache related options to
configuration yaml.
Signed-off-by: chlins <chenyuzh@vmware.com>
2022-04-25 18:01:45 +08:00
chlins
f7d10474d1
migrations: correct project metadata public value
...
Signed-off-by: chlins <chenyuzh@vmware.com>
2022-03-28 15:17:20 +08:00
stonezdj
9d480a84d2
Create index on task with job_id
...
Missing index with job_id, when query task with job_id, it cause a full table scan, caused performance issue
Fixes #15271
Signed-off-by: stonezdj <stonezdj@gmail.com>
2022-03-02 20:51:36 +08:00
MinerYang
74d2670616
bump up Go version to 1.17.7 ( #16415 )
...
Signed-off-by: yminer <yminer@vmmware.com>
update CONTRIBUTING.md 2.4 golang version to 1.17.7
Signed-off-by: yminer <yminer@vmmware.com>
Co-authored-by: yminer <yminer@vmmware.com>
2022-02-25 17:23:18 +08:00
MinerYang
6f1f2c0395
update 2.5.0 migration script harbor.yml.jinja ( #16354 )
...
Signed-off-by: yminer <yminer@vmmware.com>
Co-authored-by: yminer <yminer@vmmware.com>
2022-02-11 17:30:06 +08:00
MinerYang
6c97d3f0c7
rollback to delete external redis username ( #16353 )
...
Signed-off-by: yminer <yminer@vmmware.com>
Co-authored-by: yminer <yminer@vmmware.com>
2022-02-11 17:28:10 +08:00
MinerYang
77b6a130f8
Add Migration Script for Harbor 2.5 ( #16346 )
...
* add Harbor2.5 migration script
Signed-off-by: yminer <yminer@vmmware.com>
* update 2_5_0 migration harbor.yml.jinja
Signed-off-by: yminer <yminer@vmmware.com>
Co-authored-by: yminer <yminer@vmmware.com>
2022-02-11 12:18:06 +08:00
Wang Yan
6c3f9a8366
bump up distribution version to v2.8 ( #16338 )
...
Signed-off-by: Wang Yan <wangyan@vmware.com>
2022-02-10 11:46:58 +08:00