Commit Graph

1101 Commits

Author SHA1 Message Date
Yang Jiao
406e6ea1e3 Update Artifact size cell xpath
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-01-06 13:47:15 +08:00
Yang Jiao
338ab5844a Temp disable test cases that rely on notary
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-12-23 17:14:17 +08:00
Yang Jiao
3d26bbc2e2
Merge pull request #16110 from YangJiao0817/fix-test-ldap-server
Modify test ldap button xpath
2021-12-14 09:28:52 +08:00
DQ
12b5338985 Remove temporty workaround of openssl issue
Signed-off-by: DQ <dengq@vmware.com>
2021-12-10 11:34:18 +08:00
Yang Jiao
83e7e8528c Modify test ldap button xpath
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-12-10 03:25:27 +00:00
Yang Jiao
367dd02ef8 Modify build-package branch master to main
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-12-07 17:01:11 +08:00
Yang Jiao
4a2242fe47 Fix core private key
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-12-03 10:55:35 +08:00
Yang Jiao
43912674b1
Add robot account do replication test case (#16044)
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-29 10:58:01 +08:00
Yang Jiao
e9c5b3e759 Add replication testcase for exclude and bandwidth
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-19 09:20:07 +00:00
Yang Jiao
0a845d6369
Merge pull request #16008 from YangJiao0817/fix-cnab-case
Refactor cnab push test case
2021-11-17 11:00:05 +08:00
Yang Jiao
97ad26af6f Refactor cnab push test case
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-16 15:43:23 +08:00
Yang Jiao
8055374520 Specify test redis image tag
Specify the test redis mirror tag. If not specified, the default tag is latest. If the latest tag changes, it will cause false positives in the test case.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-15 11:30:10 +08:00
Yang Jiao
e3fac7eb53 Specify test redis image tag
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-12 10:49:30 +08:00
Yang Jiao
33fd4c06e1
Merge pull request #15978 from YangJiao0817/add-stop-scan-case
Add stop scan and stop scan all test cases
2021-11-11 18:01:14 +08:00
Yang Jiao
cfbbc82219
Merge pull request #15956 from YangJiao0817/refactor-ci-script
Modify ci script
2021-11-11 17:00:42 +08:00
Yang Jiao
9662c8316d
Merge pull request #15938 from YangJiao0817/include-test-case-e2e-image
Add e2e image include test case
2021-11-11 16:59:04 +08:00
Yang Jiao
f7b83a8e97
Merge branch 'main' into add-stop-scan-case 2021-11-11 16:50:55 +08:00
Yang Jiao
98e9ad82a1 Refactor ci script
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-11 16:04:09 +08:00
Yang Jiao
b0d6b242ae Add stop scan and stop scan all test cases
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-09 16:58:31 +08:00
Yang Jiao
d7f53e51a9 Add test case to verify imgpkg in nightly
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-09 14:35:05 +08:00
Yang Jiao
360809bfd2 Add e2e image include test case
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-03 18:31:00 +08:00
Yang Jiao
2d6973febf
Merge pull request #15905 from YangJiao0817/add-wasm-to-harbor-case
Add wasm-to-oci test cases for harbor push and pull
2021-11-02 16:51:38 +08:00
Yang Jiao
b3c959a7ab
Merge pull request #15879 from YangJiao0817/add-helm3.7-case2python
Add test cases helm3.7 CLI push in python test
2021-11-02 16:51:04 +08:00
Yang Jiao
37bc1872e2 Add wasm-to-oci test cases for harbor push and pull
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-10-29 16:26:02 +08:00
Yang Jiao
72be9df283 Add test cases helm3.7 CLI push in python test
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-10-27 18:59:08 +08:00
Aaron Layfield
7b75a456d3
Robot Account CREATE / DELETE Label (#15815)
Signed-off-by: Aaron Layfield <aaron.layfield@gmail.com>
2021-10-27 14:24:07 +08:00
Yang Jiao
57431aa8cc
Support helm3.7 in nightly (#15819)
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-10-26 17:27:45 +08:00
Yang Jiao
60ab3aeb27
Merge pull request #15832 from YangJiao0817/fix-python-testcase-security
Fix issues in python api test
2021-10-26 11:16:26 +08:00
Wang Yan
a956758302
bump up go version to v1.17 (#15865)
* bump up go version to v1.17

Signed-off-by: Wang Yan <wangyan@vmware.com>

* gofmt fail

Signed-off-by: Wang Yan <wangyan@vmware.com>
2021-10-25 17:28:29 +08:00
Yang Jiao
9178ba1138 Fix issues in python api test
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-10-23 13:26:48 +08:00
He Weiwei
619d3e818c feat: bump up trivy adater to v0.23.0
Closes #14983

Signed-off-by: He Weiwei <hweiwei@vmware.com>
2021-10-22 09:07:40 +00:00
Shengwen YU
3f75f0db32
feat: add python testing script for stop scan job (#15779)
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>

Co-authored-by: Shengwen Yu <yshengwen@vmware.com>
2021-10-18 13:13:53 +08:00
Soumik Majumder
b4c2ff7768
Fix bad and missing shebangs (#15783)
Signed-off-by: Soumik Majumder <soumikm@vmware.com>
2021-10-14 20:09:41 +08:00
Yang Jiao
bc321a331a Update robot account permission item all list
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-10-13 09:46:56 +08:00
Yang Jiao
e79dd316cd Update helm cm-push plugin
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-10-08 15:27:44 +08:00
Yang Jiao
a404cda6ce Fix User View Logs test case error
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-09-24 12:24:57 +08:00
YangJiao
5533015fd1 Add Go To Harbor Api Page TestCase
Signed-off-by: YangJiao <jiaoya@vmware.com>
2021-09-17 16:06:11 +08:00
Yang Jiao
192a97c85f
Merge pull request #15545 from YangJiao0817/add-test-cases-to-download-helm-charts-from-UI
Add TestCase to download helmchart from UI
2021-09-15 11:00:06 +08:00
YangJiao
a4a82d763a Add TestCase to download helmchart from UI
Signed-off-by: YangJiao <jiaoya@vmware.com>
2021-09-13 14:06:44 +08:00
Wang Yan
dbcbc8bad0
bump up go to v1.16.7 (#15564)
Signed-off-by: Wang Yan <wangyan@vmware.com>
2021-09-09 17:58:00 +08:00
danfengliu
a4331f6b60 add-notary-resign-test-in-upgade-pipeline
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-08-10 20:41:12 +08:00
danfengliu
8a80f82bb5
Merge pull request #15328 from danfengliu/fix-nightly-ca-header-issue
Fix nightly ca header issue
2021-07-23 15:35:04 +08:00
Wang Yan
dd6fb049f5
drop adminjob router (#15326)
As the admin job has already droped from v2.3, remove the request handling from router.

Signed-off-by: Wang Yan <wangyan@vmware.com>
2021-07-19 17:12:31 +08:00
孙世军
43da6467c0
Add a case of deleting an OIDC user (#15309)
Signed-off-by: AllForNothing <sshijun@vmware.com>
2021-07-19 10:56:06 +08:00
danfengliu
32ea961f9f Fix nightly ca header issue
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-07-18 10:44:40 +08:00
DQ
b7128a6afa Fix regex parsing IP issue in test scirpt
add `^` to constraint IP addr matching only when the pattern start from the begining

Signed-off-by: DQ <dengq@vmware.com>
2021-07-15 16:12:03 +08:00
danfengliu
8947a62dc4 Fix replication test issue in nightly
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-07-11 17:54:55 +08:00
Wang Yan
494d74d32d
bump up go version to 1.16 (#15286)
Signed-off-by: Wang Yan <wangyan@vmware.com>
2021-07-08 16:25:15 +08:00
Wang Yan
cdb7f4514e
fix cross mount conformance test (#15274)
fixes #15273

set the cross mount namespace for conformance test, the default vaule cannot pass the reponame validation.

Signed-off-by: Wang Yan <wangyan@vmware.com>
2021-07-08 15:11:01 +08:00
danfengliu
646ca80187
Fix nightly test failures broken by UI change (#15233)
1. Fix break of byte statistic unit changing;
2. Fix OIDC login UI changing.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-07-02 10:19:43 +08:00
danfengliu
65663cae52 Increase retry times for checking replication result
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-06-23 09:49:34 +08:00
Will Sun
be3f499b9b
Fix nightly failure (#15161)
Signed-off-by: AllForNothing <sshijun@vmware.com>
2021-06-18 17:53:26 +08:00
danfengliu
0bea79df93 Remove workround for docker20 adaptation
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-06-09 14:57:52 +08:00
danfengliu
896327a845
Merge pull request #14998 from danfengliu/fix-replication-namespace-level-issue
Fix replication namespace level issue
2021-06-09 14:15:44 +08:00
danfengliu
254c4a3497
Merge pull request #15046 from danfengliu/refine-base-build-process-in-makefile
Refind build base process in Makefile
2021-06-09 11:21:48 +08:00
DQ
1b6b47f860 Add IPv6 support
* 127.0.0.1 to localhost
* listening net addr add ipv6 format

Signed-off-by: DQ <dengq@vmware.com>
2021-06-03 09:04:49 +00:00
danfengliu
d66ea07c2f Refind build base process in Makefile
Remove build base executable in Makefile by replacing it as an input parameter.
Add add more input parameters for controlling docker pull/push to make
build base process flexible for users.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-06-03 14:48:34 +08:00
danfengliu
be6ce16223 Add UI test for replicaiton flattening
1. Fix replication namespace level issue;
2. Add UI test for replicaiton flattening.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-05-31 14:14:50 +08:00
danfengliu
a40d609164 Remove customize case from common test
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-05-26 10:46:11 +08:00
danfengliu
344e51d2c6 Fix build base workflow issues
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-05-25 18:13:15 +08:00
danfengliu
3ef4dc17fc Fix notary trust directory issue and add login for each base image in makefile
1. Use root instead of ~ in notary parameter;
2. Fix tag immutability issue caused by GUI change;
3. Replace email domain name to harbor test;
4. Add login for each base image in makefile;
5. Add customize look test in nightly.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-05-20 18:23:13 +08:00
Wang Yan
0fb520a33b bump up go to v1.15.12
Signed-off-by: Wang Yan <wangyan@vmware.com>
2021-05-14 15:36:23 +08:00
danfengliu
072f364d0b Add manifest and CNAB replication tests
1. Add manifest and CNAB replication tests;
2. Duplicate ORAS and sigularity tests from API test to nightly common
tests;
3. Optimize get dns code in CI;
4. Optimize E2E dockerfile;
5. Sample image size should be cover requirement for large size like 512M.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-05-10 21:47:48 +08:00
stonezdj(Daojun Zhang)
c7852df8d3
Remove unused items in legacy_swagger.yaml (#14785)
Also updated the api test

Signed-off-by: stonezdj <stonezdj@gmail.com>
2021-05-06 10:55:33 +08:00
stonezdj(Daojun Zhang)
46dcf7b0cb
Add missing operationId in swagger.yaml (#14722)
Add operationId for systeminfo api
Add operationId for configure api
Update api test after adding operationId

Fixes #14617

Signed-off-by: stonezdj <stonezdj@gmail.com>
2021-04-27 12:35:00 +08:00
Will Sun
af12f9aa01
Refactor tag-retention page (#14749)
Signed-off-by: AllForNothing <sshijun@vmware.com>
2021-04-26 14:27:44 +08:00
danfengliu
81b26418c1
Fix build base related issues (#14733)
1. Add build base image step in build package git action workflow;
2. Add build base step to UT test in CI, base image used by UI test should be built before building harbor image in the same runtime;
3. In build package workflow, trigger build base image step in condition of changing both in
Dockerfile.base and VERSION;
4. Add tag for setup nightly test.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-04-23 11:55:30 +08:00
danfengliu
f0ebd17994 Add build base image step in build package git action workflow
Build base image step should be in build package workflow, and local base images build by new step should be removed since images have been pushed to docker hub.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-04-17 18:10:44 +08:00
Wang Yan
6e3c9e29df
Api refactor label (#14650)
* Refactor labl api

move to the new program model

Signed-off-by: wang yan <wangyan@vmware.com>

* continue resolve review comments

Signed-off-by: Wang Yan <wangyan@vmware.com>
2021-04-15 17:27:58 +08:00
Wenkai Yin
654f4d9202 Refactor health check API
Refactor the health check API

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2021-04-15 14:50:27 +08:00
He Weiwei
dc37c83e11
refactor: use singular as the tag for user APIs (#14654)
Use singular as the tag for user APIs to align with other APIs.

Signed-off-by: He Weiwei <hweiwei@vmware.com>
2021-04-15 10:52:48 +08:00
stonezdj
751d404519 Refactor project member api to new programming model
Add pkg/member/dao
    Add pkg/member/models
    Add pkg/member/manager
    Add controller/member
    Remove the old project member API

Signed-off-by: stonezdj <stonezdj@gmail.com>
2021-04-13 21:28:54 +08:00
Daniel Jiang
d4cd2b87bd API for users to new model
This commit moves the legacy apis related to users to new model.
Some funcs under common/dao are left b/c they are used by other module,
which should also be shifted to leverage managers.
We'll handle them separately.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2021-04-13 11:11:50 +08:00
stonezdj
ac5e908597 Refactor user group to new programming model
Add context to required methods
Add pkg/usergroup/dao
Add pkg/usergroup/manager
Add controller/usergroup/controller

Signed-off-by: stonezdj <stonezdj@gmail.com>
2021-04-09 14:40:48 +08:00
stonezdj
107e468b60 Refactor configure api to new programming model
Changes include:
1. Move core/config to controller/config
2. Change the job_service and gcreadonly to depends on lib/config instead of core/config
3. Move the config related dao, manager and driver to pkg/config
4. Adjust the invocation of the config API, most of then should provide a context parameter, when accessing system config, you can call it with background context, when accessing user config, the context should provide orm.Context

Signed-off-by: stonezdj <stonezdj@gmail.com>
2021-04-09 08:10:11 +08:00
Qian Deng
c5d12ce8ee
Merge pull request #14542 from ninjadq/add_task_info_in_exporter
Add task info in exporter
2021-04-07 18:17:26 +08:00
DQ
dcb28d8e30 Add test case for exporter
add e2e test to verify exporter and jobservice metrics exist

Signed-off-by: DQ <dengq@vmware.com>
2021-04-06 15:54:33 +08:00
danfengliu
fbf2409c78
Merge pull request #14472 from danfengliu/add-tests-for-manifest-replication
Add test for manifest replication
2021-04-02 17:39:14 +08:00
danfengliu
1801a3cee3 Add manifest and CNAB replication tests
1. Add manifest and CNAB replication tests;
2. Duplicate ORAS and sigularity tests from API test to nightly common
tests;
3. Optimize get dns code in CI;
4. Optimize E2E dockerfile;
5. Sample image size should be cover requirement for large size like 512M.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-04-02 15:39:30 +08:00
Wenkai Yin(尹文开)
28596c3ffb
Refactor registry API (#14528)
* Refactor registry API

Refactor registry API

Signed-off-by: Wenkai Yin <yinw@vmware.com>

* Fix bugs of replications

1. Fix the scheduled replication doesn't work issue
2. Fix the destination name lost issue when updating replication policy

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2021-03-31 15:49:23 +08:00
Wenkai Yin
3d7fd070c7 Refeactor replication policy APIs
Refeactor replication policy APIs

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2021-03-17 10:57:31 +08:00
danfengliu
068d1d46ca Fix API python tests log missing issue
After debugging for issue of missing some http message logs, we found out that swagger client configuration will be re-initiated by calling models in swagger client, so in API python tests, defination for models must be in front of swagger client defination.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-03-15 17:23:13 +08:00
Daniel Jiang
0d4992a41e
API for system CVE allowlist to new model (#14412)
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2021-03-12 10:23:48 +08:00
danfengliu
b181d4df16
Merge pull request #14321 from danfengliu/fix-quotas-test-in-upgrade-pipeline
Fix quotas test issue in upgrade pipeline
2021-03-10 15:59:33 +08:00
danfengliu
a2fc1bcfaf Fix quotas test issue in upgrade pipeline
1. Change way for quotas verification in upgrade pipeline, prepare specific size of image, then it's an known value for verifcation;
2. Add notary key rotate test;
3. For issue brought by docker 20, clean containerd cache is the only effective way, so both dockerd and containerd should be cache cleard and restarted;
4. Upgrade E2E Dockerfile for importing readable file size package, and other issues;
5. Uncomment project level robot account test in nightly.
6. Get DNS from local setting, and set it into docker deamon config file;

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-03-10 06:27:22 +00:00
Wang Yan
85254ccc22
refactor immutable rule (#14371)
Migrate immutable realted APIs to v2 swagger

Signed-off-by: wang yan <wangyan@vmware.com>
2021-03-08 17:10:12 +08:00
Wenkai Yin(尹文开)
4c2e698af8
Merge pull request #14341 from heww/refactor-scanner-apis
refactor: generate scanner APIs by go-swagger
2021-03-04 17:48:04 +08:00
danfengliu
85c10c1c31 Remove python3.7 deployment in CI installtion phase.
Git action work node OS had python3.8 deployed already, so won't necessary to install python3.7 in CI.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-03-04 14:24:19 +08:00
He Weiwei
ef0bdf6954 refactor: generate scanner APIs by go-swagger
Signed-off-by: He Weiwei <hweiwei@vmware.com>
2021-03-03 04:23:36 +00:00
He Weiwei
4b033c266a refactor: generate quota APIs by go-swagger
Signed-off-by: He Weiwei <hweiwei@vmware.com>
2021-02-25 08:19:55 +00:00
danfengliu
7fb9dbd0fa Upgrade docker and containerd
1. Fix E2E quotas issue, push the same image but with different name;
2. Add checkpoint for robot account test;
3. Upgraded docker and containerd in E2E image;
4. Package base image sample(busybox) into E2E image, so in E2E
container, all local docker images can be cleaned up, once base image is needed for
building image, it can be loaded locally;
5. Adapt OIDC service of supporting LDAP user, and add OIDC group user
test;
6. Restart docker deamon before content trust test, both in API and UI
test;
7. Add retry for keyword "Add A Tag Immutability Rule";
8. Fix tag retention test issue, missing click angle icon, and enhance
checkpoint of dry run and real run;
9. Fix schedule test issue for wrong cron string;
10. Disable quotas verification, it's not stable for script defect;

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-02-24 15:43:11 +08:00
Will Sun
84f672bef5
Fix nightly failure for p2p case (#14261)
Signed-off-by: sshijun <sshijun@vmware.com>
2021-02-23 09:56:01 +08:00
Josh Soref
dfe360040b Spelling
* addition
* attribute
* auditing
* availability
* available
* bandwidth
* browser
* business
* cadence
* chartmuseum
* client
* column
* content
* demonstrate
* described
* endpoints
* facilitate
* github
* harbor
* information
* instance
* manual
* meaningful
* operation
* overridden
* password
* possible
* project
* refactor
* replication
* requires
* running
* scanned
* settings
* signup
* those
* unsigned
* vulnerability

--
Also removes trailing space from a filename

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
2021-02-19 11:59:15 +08:00
danfengliu
f51bcd9fdf
Merge pull request #14092 from dirkmueller/zip_slip
Update oras to 0.9.0 to fix "zip slip" vulnerability
2021-02-07 16:15:11 +08:00
Wang Yan
885a268268
rename permission of robot account (#14150)
* rename permission of robot account

fixes #14060
Signed-off-by: Wang Yan <wangyan@vmware.com>
2021-02-04 15:32:44 +08:00
Qian Deng
6d78189dff
Merge pull request #14117 from ninjadq/fix_quota_metric_name
Chagne quota usage metric name
2021-01-29 10:36:55 +08:00
danfengliu
b0e54f5a33
Merge pull request #14041 from danfengliu/upgrade-containerd-in-e2e-dockerfile
Upgrade containerd in E2E Dockerfile
2021-01-29 09:42:41 +08:00
DQ
eb5e31a442 Chagne quota usage metric name
from `harbor_project_usage_byte` to `harbor_project_quota_usage_byte`

Signed-off-by: DQ <dengq@vmware.com>
2021-01-28 18:10:59 +08:00
Qian Deng
ebe05919be
Merge pull request #14078 from ninjadq/fix_self_registration_metric
Fix metric label related things
2021-01-28 17:27:53 +08:00
danfengliu
642bb26c39 Fix nightly issues caused by docker upgrade to 20
1. Local image should be removed, otherwise docker 20 will not tigger
get manifest request to harbor;
2. E2E image Dockerfile update;
3. Fix nighlty test issue of tag retention, add execution refesh to get
result;
4. Fix nighlty test keyword 'Create An New Project And Go Into
Project' issue that waiting long enough time for list display;
5. Add nightly test case, in GUI, scan result will show if cve id exist in allow list configuration;
6. Move proxy cache test to schdule pipeline, it will save some time for
db pipeline.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-01-28 11:44:32 +08:00