Commit Graph

477 Commits

Author SHA1 Message Date
Yang Jiao
a534094ec0
Update Robot Account Test Case (#19710)
Update project and system robot account testcase
Update system robot account do replication testcase

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-12-14 03:26:25 +00:00
Yang Jiao
ed0a69cf80
Add external scanner test case (#19682)
Fix #19279

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-12-07 11:20:11 +08:00
Yang Jiao
38ac8bf717
Add notation pull policy test case (#19625)
Fix #19547

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-11-27 09:44:20 +00:00
Yang Jiao
969dd1be66
Add notation accessory copy test case (#19605)
Fix #19546

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-11-22 18:13:44 +08:00
Yang Jiao
6d238f1948
Update E2E test engine images (#19544)
Fix #19283
1. Bump up chromedriver version to 119.0.6045.105
2. Bump up containerd version to 1.7.8
3. Bump up docker compose version to 2.23.0
4. Bump up helm version to 3.13.1
5. Bump up ORSA version to 1.1.0
6. Bump up imgpkg version to 0.39.0
7. Bump up cosign version to 2.2.0
8. Add install notation 1.0.0

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-11-07 11:05:29 +08:00
Yang Jiao
e1a44232f4
Add banner message UI test case (#19529)
Fix #19272

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-11-06 03:41:35 +00:00
Yang Jiao
58557d3bae
Add GC details and GC workers UI test case (#19487)
Fix #19277

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-10-26 11:49:56 +08:00
Yang Jiao
f58dc2dbec
Add GC accessory UI test case (#19470)
Fix #19274

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-10-23 07:46:00 +00:00
Yang Jiao
ec0ef1772c
Add security hub UI test case (#19448)
Fix #19270

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-10-16 18:17:29 +08:00
Yang Jiao
97b285168a
Refactor unstable test cases (#19350)
Fix #19282

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-09-13 08:14:34 +00:00
Yang Jiao
7862870c45
Update webhook and replication testcase (#18998)
Sync test case updates because of changes to webhook and replication
1. #18923
2. #18906

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-07-25 15:06:04 +08:00
Yang Jiao
90259f3c80
Add CVE Allowlist expires Test Cases (#18921)
Fix #18920

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-07-12 17:32:40 +08:00
Yang Jiao
c707106ef7
Add OIDC filter group testcase (#18914)
Fix #17950

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-07-11 15:37:15 +08:00
Yang Jiao
cbb211e670
Add CloudEvents format webhook testcase (#18908)
Fix #18616

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-07-10 15:05:56 +08:00
Yang Jiao
adf80e921e
Add replication by chunk testcase (#18904)
Fix #17951

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-07-07 15:18:22 +08:00
Yang Jiao
fb52fdb3e0
Refactor the keyword in the testcase (#18898)
Fix #17952

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-07-06 13:47:00 +08:00
Yang Jiao
210186f479
Update e2e engine image (#18747)
1. Update containerd version to 1.7.1
2. Update docker compose version to 2.18.1
3. Update helm version to 3.12.0
4. Update ORAS version to 1.0.0
5. Update CNAB version to 0.4.0
6. Update imgpkg version to 0.36.2
7. Update cosign version to 2.0.2
8. Update docker version to 24.0.2
9. Update chromedriver version to 114.0.5735.16

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-05-29 11:55:14 +08:00
Yang Jiao
ac70a14397
Add Retain image last pull time UI test case (#18695)
Fix #18690

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-05-19 16:31:01 +08:00
Yang Jiao
c09e539027
Remove notary test cases (#18620)
Fix #17955

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-04-28 16:09:40 +08:00
Yang Jiao
0da12250ce
Add Job Service Dashboard Workers testcase (#18580)
Fix #17949

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-04-23 21:26:44 +08:00
Yang Jiao
c7cbf0fcdb
Add Job Service Dashboard Schedules testcase (#18555)
Fix #17949

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-04-20 11:11:59 +08:00
Yang Jiao
cbf0a86ba2
Update UI testcases (#18491)
1. Update copy test case to add retries
2. Updata P2P Preheat test case to waiting
3. Update the Replication new rule button xpath

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-04-07 17:22:58 +08:00
Yang Jiao
f5be644d35
Update UI test cases (#18470)
1. Update replication role testcase
2. Update job service dashboard testcase

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-04-03 16:01:51 +08:00
Yang Jiao
a95808c120
Update webhook and repliation element xpath (#18456)
Update webhook xpath
Update replication xpath

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-03-31 11:00:16 +08:00
Yang Jiao
26ce10221e
Add Job Service Dashboard Job Queues testcase (#18347)
Fix #17949

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-03-14 17:09:19 +08:00
Yang Jiao
660e1d1362
Remove chartmuseum test case (#18267)
Harbor deprecates chartmuseum as of v2.8.0
Epic: #17958
Discussion: #15057

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-02-24 10:56:28 +08:00
Wang Yan
738fde7d3b
remove chartmuseum backend (#18191)
Harbor deprecates chartmuseum as of v2.8.0

Epic: https://github.com/goharbor/harbor/issues/17958

Discussion: https://github.com/goharbor/harbor/discussions/15057

Signed-off-by: Wang Yan <wangyan@vmware.com>
2023-02-16 18:11:05 +08:00
Yang Jiao
fd5cb73e26
Modify audit log forward test case (#17780)
Modify the audit log forward test case to forward the audit log to elk

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-11-18 18:03:46 +08:00
Yang Jiao
484abd6213
Update e2e engine image (#17793)
1. Update ubuntu version to 20.04
2. Update containerd version to 1.6.9
3. Update docker-compose version to 2.12.2
4. Update helm version to 3.10.1
5. Update ORAS version to 0.16.0
6. Update CNAB version to 0.3.7
7. Update imgpkg version to 0.33.0
8. Update cosign version to 1.13.1
9. Remove singularity

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-11-14 14:02:23 +08:00
Yang Jiao
e2e8f00f35
Remove email config testcases (#17763)
Because the email config page has been removed #17711

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-11-08 15:55:22 +08:00
Yang Jiao
f147af91c8
Add export CVE UI testcase (#17672)
1 Add CVE function verification
2 Add content validation of exported CSV file

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-10-21 18:42:08 +08:00
Yang Jiao
c1c1aaf612
Add audit log forward UI testcase (#17591)
Verify that the audit log forward function is correct.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-09-27 10:46:16 +08:00
Yang Jiao
a686f30b01
Update filter label xpath (#17585)
Because this PR #17577 modifies the filter label

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-09-22 10:50:29 +08:00
Yang Jiao
a56d927143
Remove the log in testcase (#17500)
Remove logs that do not need to be printed

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-09-06 14:15:45 +08:00
Yang Jiao
0ec167a7c1
Add audit log and log rotation test cases (#17465)
1. Add audit log test case
2. Add log rotation test case
3. Add log rotation schedule test case

Signed-off-by: Yang Jiao <jiaoya@vmware.com>

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-08-26 18:00:12 +08:00
Yang Jiao
f913b84a01
Update replication and trivy testcases (#17367)
1 Update replication filter_label_xpath because of this PR #17267 updated xpath
2 Update the Manual Scan All test case, because Scan All will affect other testcases if it is not finished running

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-08-10 18:26:36 +08:00
Shijun Sun
04fa3853c9
Fix router issues for UI (#17235)
Signed-off-by: AllForNothing <sshijun@vmware.com>
2022-07-29 19:04:01 +08:00
Yang Jiao
e58f18bd51
Update routing test case (#17221)
Add retry to improve test case stability

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-07-21 17:40:38 +08:00
Yang Jiao
72cd65df6a
Update delete multi project testcase (#17169)
Because this PR(#16236) update the delete project button xpath, so update synchronously

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-07-14 22:47:53 +08:00
Yang Jiao
349d220372
Update delete project test case (#17158)
Because this PR(#16236) update the delete project button xpath, so update synchronously

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-07-13 17:39:12 +08:00
Yang Jiao
f852996fe5
Update tag immutability xpath (#17149)
Because this PR(#17138) update the tag immutability xpath, so update synchronously

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-07-11 15:59:55 +08:00
Yang Jiao
90e9b997bf
Enhancement Stop Scan Testcase (#17105)
Added error retries to improve test stability

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-30 17:40:30 +08:00
Yang Jiao
ff4eb7f27c
Add P2P Preheat Test case (#17089)
1.Add P2P Preheat test case triggered by manual
2.Add P2P Preheat test case triggered by events(Artifact is pushed Artifact is scanned Artifact is labeled)
3.Add P2P Preheat test case triggered by schedule
4.Migrated Distribution CRUD and P2P Preheat Policy CRUD to P2P_Preheat.robot for classification

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-28 18:14:46 +08:00
Yang Jiao
a594f5649d
Enhance webhook testcase (#17031)
Increase retry to improve test case stability.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-21 14:28:43 +08:00
Yang Jiao
9b7289d862
Update GC UI Testcase (#16975)
This PR #16941 modifies the GC UI, so update the test cases.
1 Update GC web element xpath.
2 Migrate GC content from Configuration.robot to GC.robot for classification.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-13 14:19:32 +08:00
Yang Jiao
a2829850b8
Update CVE allowlist UI test case (#16980)
Because this PR #16941 migrates CVE allowlist from Configuration System
Settings page to Configuration Security page.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-13 11:54:58 +08:00
Yang Jiao
5dcd2ccf8e
Add webhook functionality test case (#16944)
1.Add Webhook Tester to the test environment.
2.Create a new project and enable webhook.
3.Trigger different event types(Artifact pushed、Artifact
pulled、Artifact deleted、Scanning finished、Scanning stopped、Tag
retention finished、Replication finished、Quota near threshold、Quota exceed).
4.Verify that the message is correct in the Webhook Tester.
5.Moved Webhook CRUD test cases from Common.robot to Webhook.robot for
triage.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-06-07 17:10:11 +08:00
Yang Jiao
9b154e700c Update header user xpath
Update it because #16796 modifies header user.

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-05-27 08:16:14 +00:00
Yang Jiao
4d116893be
Merge pull request #16832 from YangJiao0817/update-cosign-testcase
Update cosign test case
2022-05-10 16:18:16 +08:00
Yang Jiao
49ddaee603 Update cosign test case
1 bump up cosign version to 1.8.0
2 Add cosign Verify test

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-05-10 07:01:27 +00:00