Commit Graph

325 Commits

Author SHA1 Message Date
Yang Jiao
f913b84a01
Update replication and trivy testcases (#17367)
1 Update replication filter_label_xpath because of this PR #17267 updated xpath
2 Update the Manual Scan All test case, because Scan All will affect other testcases if it is not finished running

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-08-10 18:26:36 +08:00
Shijun Sun
04fa3853c9
Fix router issues for UI (#17235)
Signed-off-by: AllForNothing <sshijun@vmware.com>
2022-07-29 19:04:01 +08:00
Yang Jiao
e58f18bd51
Update routing test case (#17221)
Add retry to improve test case stability

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-07-21 17:40:38 +08:00
Yang Jiao
72cd65df6a
Update delete multi project testcase (#17169)
Because this PR(#16236) update the delete project button xpath, so update synchronously

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-07-14 22:47:53 +08:00
Yang Jiao
349d220372
Update delete project test case (#17158)
Because this PR(#16236) update the delete project button xpath, so update synchronously

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-07-13 17:39:12 +08:00
Yang Jiao
f852996fe5
Update tag immutability xpath (#17149)
Because this PR(#17138) update the tag immutability xpath, so update synchronously

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-07-11 15:59:55 +08:00
Yang Jiao
90e9b997bf
Enhancement Stop Scan Testcase (#17105)
Added error retries to improve test stability

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-30 17:40:30 +08:00
Yang Jiao
ff4eb7f27c
Add P2P Preheat Test case (#17089)
1.Add P2P Preheat test case triggered by manual
2.Add P2P Preheat test case triggered by events(Artifact is pushed Artifact is scanned Artifact is labeled)
3.Add P2P Preheat test case triggered by schedule
4.Migrated Distribution CRUD and P2P Preheat Policy CRUD to P2P_Preheat.robot for classification

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-28 18:14:46 +08:00
Yang Jiao
a594f5649d
Enhance webhook testcase (#17031)
Increase retry to improve test case stability.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-21 14:28:43 +08:00
Yang Jiao
9b7289d862
Update GC UI Testcase (#16975)
This PR #16941 modifies the GC UI, so update the test cases.
1 Update GC web element xpath.
2 Migrate GC content from Configuration.robot to GC.robot for classification.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-13 14:19:32 +08:00
Yang Jiao
a2829850b8
Update CVE allowlist UI test case (#16980)
Because this PR #16941 migrates CVE allowlist from Configuration System
Settings page to Configuration Security page.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-13 11:54:58 +08:00
Yang Jiao
5dcd2ccf8e
Add webhook functionality test case (#16944)
1.Add Webhook Tester to the test environment.
2.Create a new project and enable webhook.
3.Trigger different event types(Artifact pushed、Artifact
pulled、Artifact deleted、Scanning finished、Scanning stopped、Tag
retention finished、Replication finished、Quota near threshold、Quota exceed).
4.Verify that the message is correct in the Webhook Tester.
5.Moved Webhook CRUD test cases from Common.robot to Webhook.robot for
triage.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-07 17:10:11 +08:00
Yang Jiao
9b154e700c Update header user xpath
Update it because #16796 modifies header user.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-05-27 08:16:14 +00:00
Yang Jiao
18b9856dc5 Add imgpkg copy test case
Add this test case to make sure imgpkg copy to Harbor works.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-04-27 06:25:11 +00:00
Yang Jiao
1207982925 Add test case for Enable Deployment Security Policy replication
Add test cases for these three different scenarios to ensure that Replication functions correctly after Deployment Security Policy is enabled

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-04-25 02:59:20 +00:00
Yang Jiao
c5591cba46 Add open image scanners documentation page test case
Add a test case for opening the Image Scanners Documentation Page to ensure this function is correct

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-04-18 09:14:47 +00:00
Yang Jiao
c1781bfb74 Add open license test case
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-04-15 08:08:05 +00:00
Yang Jiao
76e781c446 Update webhook testcase xpath from disable to deactivate
Synchronous modification due to UI changes

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-03-24 06:38:24 +00:00
Yang Jiao
62afa16b57
Add replication test cases triggered by events (#16466)
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-03-04 14:11:57 +08:00
Yang Jiao
999adfad82
Add replication cosign test case (#16313)
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-01-29 11:23:26 +08:00
Yang Jiao
6e93089845 Add cosign UI test case
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-01-18 02:05:31 +00:00
Yang Jiao
cefdfad35a Update Deployment security Notary xpath
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-01-13 07:24:00 +00:00
Yang Jiao
406e6ea1e3 Update Artifact size cell xpath
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-01-06 13:47:15 +08:00
Yang Jiao
83e7e8528c Modify test ldap button xpath
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-12-10 03:25:27 +00:00
Yang Jiao
43912674b1
Add robot account do replication test case (#16044)
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-29 10:58:01 +08:00
Yang Jiao
e9c5b3e759 Add replication testcase for exclude and bandwidth
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-19 09:20:07 +00:00
Yang Jiao
b0d6b242ae Add stop scan and stop scan all test cases
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-09 16:58:31 +08:00
Aaron Layfield
7b75a456d3
Robot Account CREATE / DELETE Label (#15815)
Signed-off-by: Aaron Layfield <aaron.layfield@gmail.com>
2021-10-27 14:24:07 +08:00
Yang Jiao
57431aa8cc
Support helm3.7 in nightly (#15819)
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-10-26 17:27:45 +08:00
Yang Jiao
bc321a331a Update robot account permission item all list
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-10-13 09:46:56 +08:00
Yang Jiao
a404cda6ce Fix User View Logs test case error
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-09-24 12:24:57 +08:00
YangJiao
a4a82d763a Add TestCase to download helmchart from UI
Signed-off-by: YangJiao <jiaoya@vmware.com>
2021-09-13 14:06:44 +08:00
danfengliu
a4331f6b60 add-notary-resign-test-in-upgade-pipeline
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-08-10 20:41:12 +08:00
danfengliu
8a80f82bb5
Merge pull request #15328 from danfengliu/fix-nightly-ca-header-issue
Fix nightly ca header issue
2021-07-23 15:35:04 +08:00
孙世军
43da6467c0
Add a case of deleting an OIDC user (#15309)
Signed-off-by: AllForNothing <sshijun@vmware.com>
2021-07-19 10:56:06 +08:00
danfengliu
32ea961f9f Fix nightly ca header issue
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-07-18 10:44:40 +08:00
danfengliu
8947a62dc4 Fix replication test issue in nightly
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-07-11 17:54:55 +08:00
danfengliu
646ca80187
Fix nightly test failures broken by UI change (#15233)
1. Fix break of byte statistic unit changing;
2. Fix OIDC login UI changing.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-07-02 10:19:43 +08:00
Will Sun
be3f499b9b
Fix nightly failure (#15161)
Signed-off-by: AllForNothing <sshijun@vmware.com>
2021-06-18 17:53:26 +08:00
danfengliu
0bea79df93 Remove workround for docker20 adaptation
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-06-09 14:57:52 +08:00
danfengliu
be6ce16223 Add UI test for replicaiton flattening
1. Fix replication namespace level issue;
2. Add UI test for replicaiton flattening.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-05-31 14:14:50 +08:00
danfengliu
a40d609164 Remove customize case from common test
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-05-26 10:46:11 +08:00
danfengliu
3ef4dc17fc Fix notary trust directory issue and add login for each base image in makefile
1. Use root instead of ~ in notary parameter;
2. Fix tag immutability issue caused by GUI change;
3. Replace email domain name to harbor test;
4. Add login for each base image in makefile;
5. Add customize look test in nightly.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-05-20 18:23:13 +08:00
danfengliu
072f364d0b Add manifest and CNAB replication tests
1. Add manifest and CNAB replication tests;
2. Duplicate ORAS and sigularity tests from API test to nightly common
tests;
3. Optimize get dns code in CI;
4. Optimize E2E dockerfile;
5. Sample image size should be cover requirement for large size like 512M.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-05-10 21:47:48 +08:00
Will Sun
af12f9aa01
Refactor tag-retention page (#14749)
Signed-off-by: AllForNothing <sshijun@vmware.com>
2021-04-26 14:27:44 +08:00
danfengliu
f0ebd17994 Add build base image step in build package git action workflow
Build base image step should be in build package workflow, and local base images build by new step should be removed since images have been pushed to docker hub.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-04-17 18:10:44 +08:00
danfengliu
1801a3cee3 Add manifest and CNAB replication tests
1. Add manifest and CNAB replication tests;
2. Duplicate ORAS and sigularity tests from API test to nightly common
tests;
3. Optimize get dns code in CI;
4. Optimize E2E dockerfile;
5. Sample image size should be cover requirement for large size like 512M.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-04-02 15:39:30 +08:00
danfengliu
a2fc1bcfaf Fix quotas test issue in upgrade pipeline
1. Change way for quotas verification in upgrade pipeline, prepare specific size of image, then it's an known value for verifcation;
2. Add notary key rotate test;
3. For issue brought by docker 20, clean containerd cache is the only effective way, so both dockerd and containerd should be cache cleard and restarted;
4. Upgrade E2E Dockerfile for importing readable file size package, and other issues;
5. Uncomment project level robot account test in nightly.
6. Get DNS from local setting, and set it into docker deamon config file;

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-03-10 06:27:22 +00:00
danfengliu
7fb9dbd0fa Upgrade docker and containerd
1. Fix E2E quotas issue, push the same image but with different name;
2. Add checkpoint for robot account test;
3. Upgraded docker and containerd in E2E image;
4. Package base image sample(busybox) into E2E image, so in E2E
container, all local docker images can be cleaned up, once base image is needed for
building image, it can be loaded locally;
5. Adapt OIDC service of supporting LDAP user, and add OIDC group user
test;
6. Restart docker deamon before content trust test, both in API and UI
test;
7. Add retry for keyword "Add A Tag Immutability Rule";
8. Fix tag retention test issue, missing click angle icon, and enhance
checkpoint of dry run and real run;
9. Fix schedule test issue for wrong cron string;
10. Disable quotas verification, it's not stable for script defect;

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-02-24 15:43:11 +08:00
Will Sun
84f672bef5
Fix nightly failure for p2p case (#14261)
Signed-off-by: sshijun <sshijun@vmware.com>
2021-02-23 09:56:01 +08:00