Commit Graph

138 Commits

Author SHA1 Message Date
Shengwen YU
9471f5d5a6
fix: update total permission count to 59 (#20352)
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
2024-04-26 08:21:27 +00:00
Shengwen YU
822784aac8
fix: update to "clr-dg-cell[10]" to fix the pull time tc due to addin… (#20361)
fix: update to "clr-dg-cell[10]" to fix the pull time tc due to adding an SBOM column

Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
2024-04-26 04:28:22 +00:00
Shengwen YU
d0cb200ed5
fix: update nightly test case for verifying audit log of image digest (#20354)
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
2024-04-26 03:44:00 +00:00
Yang Jiao
80930daaac
Add quota permissions testcase (#19822)
Signed-off-by: Yang Jiao <yang.jiao@broadcom.com>
Co-authored-by: Yang Jiao <yang.jiao@broadcom.com>
2024-01-12 10:25:38 +08:00
Yang Jiao
a534094ec0
Update Robot Account Test Case (#19710)
Update project and system robot account testcase
Update system robot account do replication testcase

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-12-14 03:26:25 +00:00
Yang Jiao
4fbcf92da9
Add jump to CNAB Bundle index artifact list test case (#19629)
Fix #19278

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-11-27 18:26:06 +08:00
Yang Jiao
38ac8bf717
Add notation pull policy test case (#19625)
Fix #19547

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-11-27 09:44:20 +00:00
Yang Jiao
969dd1be66
Add notation accessory copy test case (#19605)
Fix #19546

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-11-22 18:13:44 +08:00
Yang Jiao
e1a44232f4
Add banner message UI test case (#19529)
Fix #19272

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-11-06 03:41:35 +00:00
Yang Jiao
97b285168a
Refactor unstable test cases (#19350)
Fix #19282

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-09-13 08:14:34 +00:00
Wang Yan
db82d6e082
fix signer name (#19001)
Append the signer name to the error message which will be returned by the client

Signed-off-by: wang yan <wangyan@vmware.com>
2023-07-25 21:30:32 +08:00
Wang Yan
ff2b99d711
enable notary v2 policy checker (#18927)
add notary v2 pull policy, when it enables, the artifact cannot be pull without the notation signature.

Signed-off-by: wang yan <wangyan@vmware.com>
2023-07-14 13:35:56 +08:00
Yang Jiao
fb52fdb3e0
Refactor the keyword in the testcase (#18898)
Fix #17952

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-07-06 13:47:00 +08:00
Yang Jiao
210186f479
Update e2e engine image (#18747)
1. Update containerd version to 1.7.1
2. Update docker compose version to 2.18.1
3. Update helm version to 3.12.0
4. Update ORAS version to 1.0.0
5. Update CNAB version to 0.4.0
6. Update imgpkg version to 0.36.2
7. Update cosign version to 2.0.2
8. Update docker version to 24.0.2
9. Update chromedriver version to 114.0.5735.16

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-05-29 11:55:14 +08:00
Yang Jiao
ac70a14397
Add Retain image last pull time UI test case (#18695)
Fix #18690

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-05-19 16:31:01 +08:00
Yang Jiao
0da12250ce
Add Job Service Dashboard Workers testcase (#18580)
Fix #17949

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-04-23 21:26:44 +08:00
Yang Jiao
c7cbf0fcdb
Add Job Service Dashboard Schedules testcase (#18555)
Fix #17949

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-04-20 11:11:59 +08:00
Yang Jiao
cbf0a86ba2
Update UI testcases (#18491)
1. Update copy test case to add retries
2. Updata P2P Preheat test case to waiting
3. Update the Replication new rule button xpath

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-04-07 17:22:58 +08:00
Yang Jiao
26ce10221e
Add Job Service Dashboard Job Queues testcase (#18347)
Fix #17949

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-03-14 17:09:19 +08:00
Yang Jiao
660e1d1362
Remove chartmuseum test case (#18267)
Harbor deprecates chartmuseum as of v2.8.0
Epic: #17958
Discussion: #15057

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-02-24 10:56:28 +08:00
Wang Yan
738fde7d3b
remove chartmuseum backend (#18191)
Harbor deprecates chartmuseum as of v2.8.0

Epic: https://github.com/goharbor/harbor/issues/17958

Discussion: https://github.com/goharbor/harbor/discussions/15057

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-02-16 18:11:05 +08:00
Yang Jiao
fd5cb73e26
Modify audit log forward test case (#17780)
Modify the audit log forward test case to forward the audit log to elk

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-11-18 18:03:46 +08:00
Yang Jiao
e2e8f00f35
Remove email config testcases (#17763)
Because the email config page has been removed #17711

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-11-08 15:55:22 +08:00
Yang Jiao
f147af91c8
Add export CVE UI testcase (#17672)
1 Add CVE function verification
2 Add content validation of exported CSV file

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-10-21 18:42:08 +08:00
Yang Jiao
c1c1aaf612
Add audit log forward UI testcase (#17591)
Verify that the audit log forward function is correct.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-09-27 10:46:16 +08:00
Yang Jiao
0ec167a7c1
Add audit log and log rotation test cases (#17465)
1. Add audit log test case
2. Add log rotation test case
3. Add log rotation schedule test case

Signed-off-by: Yang Jiao <jiaoya@vmware.com>

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-08-26 18:00:12 +08:00
Yang Jiao
72cd65df6a
Update delete multi project testcase (#17169)
Because this PR(#16236) update the delete project button xpath, so update synchronously

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-07-14 22:47:53 +08:00
Yang Jiao
ff4eb7f27c
Add P2P Preheat Test case (#17089)
1.Add P2P Preheat test case triggered by manual
2.Add P2P Preheat test case triggered by events(Artifact is pushed Artifact is scanned Artifact is labeled)
3.Add P2P Preheat test case triggered by schedule
4.Migrated Distribution CRUD and P2P Preheat Policy CRUD to P2P_Preheat.robot for classification

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-28 18:14:46 +08:00
Yang Jiao
5dcd2ccf8e
Add webhook functionality test case (#16944)
1.Add Webhook Tester to the test environment.
2.Create a new project and enable webhook.
3.Trigger different event types(Artifact pushed、Artifact
pulled、Artifact deleted、Scanning finished、Scanning stopped、Tag
retention finished、Replication finished、Quota near threshold、Quota exceed).
4.Verify that the message is correct in the Webhook Tester.
5.Moved Webhook CRUD test cases from Common.robot to Webhook.robot for
triage.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-07 17:10:11 +08:00
Yang Jiao
4d116893be
Merge pull request #16832 from YangJiao0817/update-cosign-testcase
Update cosign test case
2022-05-10 16:18:16 +08:00
Yang Jiao
49ddaee603 Update cosign test case
1 bump up cosign version to 1.8.0
2 Add cosign Verify test

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-05-10 07:01:27 +00:00
Yang Jiao
18b9856dc5 Add imgpkg copy test case
Add this test case to make sure imgpkg copy to Harbor works.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-04-27 06:25:11 +00:00
Yang Jiao
6dfdda7778 Add retries to test cases
Retry to solve the ecs environment s3aws Path not found issue

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-04-12 07:16:55 +00:00
Yang Jiao
76e781c446 Update webhook testcase xpath from disable to deactivate
Synchronous modification due to UI changes

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-03-24 06:38:24 +00:00
Yang Jiao
4882def74f Add copy accessory test case
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-01-20 09:26:05 +00:00
Yang Jiao
6e93089845 Add cosign UI test case
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-01-18 02:05:31 +00:00
Yang Jiao
43912674b1
Add robot account do replication test case (#16044)
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-29 10:58:01 +08:00
Yang Jiao
97ad26af6f Refactor cnab push test case
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-16 15:43:23 +08:00
Yang Jiao
d7f53e51a9 Add test case to verify imgpkg in nightly
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-09 14:35:05 +08:00
Yang Jiao
37bc1872e2 Add wasm-to-oci test cases for harbor push and pull
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-10-29 16:26:02 +08:00
YangJiao
5533015fd1 Add Go To Harbor Api Page TestCase
Signed-off-by: YangJiao <jiaoya@vmware.com>
2021-09-17 16:06:11 +08:00
danfengliu
646ca80187
Fix nightly test failures broken by UI change (#15233)
1. Fix break of byte statistic unit changing;
2. Fix OIDC login UI changing.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-07-02 10:19:43 +08:00
danfengliu
0bea79df93 Remove workround for docker20 adaptation
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-06-09 14:57:52 +08:00
danfengliu
be6ce16223 Add UI test for replicaiton flattening
1. Fix replication namespace level issue;
2. Add UI test for replicaiton flattening.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-05-31 14:14:50 +08:00
danfengliu
a40d609164 Remove customize case from common test
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-05-26 10:46:11 +08:00
danfengliu
3ef4dc17fc Fix notary trust directory issue and add login for each base image in makefile
1. Use root instead of ~ in notary parameter;
2. Fix tag immutability issue caused by GUI change;
3. Replace email domain name to harbor test;
4. Add login for each base image in makefile;
5. Add customize look test in nightly.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-05-20 18:23:13 +08:00
danfengliu
f0ebd17994 Add build base image step in build package git action workflow
Build base image step should be in build package workflow, and local base images build by new step should be removed since images have been pushed to docker hub.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-04-17 18:10:44 +08:00
danfengliu
1801a3cee3 Add manifest and CNAB replication tests
1. Add manifest and CNAB replication tests;
2. Duplicate ORAS and sigularity tests from API test to nightly common
tests;
3. Optimize get dns code in CI;
4. Optimize E2E dockerfile;
5. Sample image size should be cover requirement for large size like 512M.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-04-02 15:39:30 +08:00
danfengliu
a2fc1bcfaf Fix quotas test issue in upgrade pipeline
1. Change way for quotas verification in upgrade pipeline, prepare specific size of image, then it's an known value for verifcation;
2. Add notary key rotate test;
3. For issue brought by docker 20, clean containerd cache is the only effective way, so both dockerd and containerd should be cache cleard and restarted;
4. Upgrade E2E Dockerfile for importing readable file size package, and other issues;
5. Uncomment project level robot account test in nightly.
6. Get DNS from local setting, and set it into docker deamon config file;

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-03-10 06:27:22 +00:00
danfengliu
7fb9dbd0fa Upgrade docker and containerd
1. Fix E2E quotas issue, push the same image but with different name;
2. Add checkpoint for robot account test;
3. Upgraded docker and containerd in E2E image;
4. Package base image sample(busybox) into E2E image, so in E2E
container, all local docker images can be cleaned up, once base image is needed for
building image, it can be loaded locally;
5. Adapt OIDC service of supporting LDAP user, and add OIDC group user
test;
6. Restart docker deamon before content trust test, both in API and UI
test;
7. Add retry for keyword "Add A Tag Immutability Rule";
8. Fix tag retention test issue, missing click angle icon, and enhance
checkpoint of dry run and real run;
9. Fix schedule test issue for wrong cron string;
10. Disable quotas verification, it's not stable for script defect;

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-02-24 15:43:11 +08:00