Yang Jiao
f147af91c8
Add export CVE UI testcase ( #17672 )
...
1 Add CVE function verification
2 Add content validation of exported CSV file
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-10-21 18:42:08 +08:00
Yang Jiao
a686f30b01
Update filter label xpath ( #17585 )
...
Because this PR #17577 modifies the filter label
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-09-22 10:50:29 +08:00
Yang Jiao
a56d927143
Remove the log in testcase ( #17500 )
...
Remove logs that do not need to be printed
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-09-06 14:15:45 +08:00
Yang Jiao
f913b84a01
Update replication and trivy testcases ( #17367 )
...
1 Update replication filter_label_xpath because of this PR #17267 updated xpath
2 Update the Manual Scan All test case, because Scan All will affect other testcases if it is not finished running
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-08-10 18:26:36 +08:00
Yang Jiao
1207982925
Add test case for Enable Deployment Security Policy replication
...
Add test cases for these three different scenarios to ensure that Replication functions correctly after Deployment Security Policy is enabled
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-04-25 02:59:20 +00:00
Yang Jiao
406e6ea1e3
Update Artifact size cell xpath
...
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2022-01-06 13:47:15 +08:00
Yang Jiao
e9c5b3e759
Add replication testcase for exclude and bandwidth
...
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2021-11-19 09:20:07 +00:00
danfengliu
32ea961f9f
Fix nightly ca header issue
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-07-18 10:44:40 +08:00
danfengliu
8947a62dc4
Fix replication test issue in nightly
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-07-11 17:54:55 +08:00
Will Sun
be3f499b9b
Fix nightly failure ( #15161 )
...
Signed-off-by: AllForNothing <sshijun@vmware.com>
2021-06-18 17:53:26 +08:00
danfengliu
be6ce16223
Add UI test for replicaiton flattening
...
1. Fix replication namespace level issue;
2. Add UI test for replicaiton flattening.
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-05-31 14:14:50 +08:00
danfengliu
f0ebd17994
Add build base image step in build package git action workflow
...
Build base image step should be in build package workflow, and local base images build by new step should be removed since images have been pushed to docker hub.
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-04-17 18:10:44 +08:00
danfengliu
1801a3cee3
Add manifest and CNAB replication tests
...
1. Add manifest and CNAB replication tests;
2. Duplicate ORAS and sigularity tests from API test to nightly common
tests;
3. Optimize get dns code in CI;
4. Optimize E2E dockerfile;
5. Sample image size should be cover requirement for large size like 512M.
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-04-02 15:39:30 +08:00
danfengliu
a2fc1bcfaf
Fix quotas test issue in upgrade pipeline
...
1. Change way for quotas verification in upgrade pipeline, prepare specific size of image, then it's an known value for verifcation;
2. Add notary key rotate test;
3. For issue brought by docker 20, clean containerd cache is the only effective way, so both dockerd and containerd should be cache cleard and restarted;
4. Upgrade E2E Dockerfile for importing readable file size package, and other issues;
5. Uncomment project level robot account test in nightly.
6. Get DNS from local setting, and set it into docker deamon config file;
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-03-10 06:27:22 +00:00
Danfeng Liu (c)
ddf9d74135
Fix nightly keyword issues
...
1. Add retry for Get Statics Text keywords make this operation robust;
2. Replace image to one with slash in name for CNAB test, to cover more
condition;
3. Add replication rule deletion verfication in upgrade test;
4. Add non-admin user in pull operation for proxy cache test;
5. Add verification for quota display for upgrade test;
6. Add test for large size of image replication;
7. Add test checkpoint for system robot account py-test script;
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2021-01-19 15:12:15 +08:00
danfengliu
3659abc62a
Migrate gitlab replication test to nightly
...
Add 2 gitlab pull/push replication test scripts in replication pipeline.
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-12-11 18:04:46 +08:00
danfengliu
ad7581d9b3
Migrate gitlab replication test to nightly
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-12-09 12:00:38 +08:00
danfengliu
2bf89e9356
Add docker-hub login before docker-hub pull
...
Due to docker-hub pull request rate limitation, we will use registed account to pull image
from docker-hub, therefore add docker-hub login in API tests.
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-11-22 21:11:05 +08:00
danfengliu
444de8536a
Suppress urllib3 warning and fix nightly element locator issue and remove switch scanner
...
1. Since upgrade python to 3.7, some urllib3 warnings come out during
execution, because missing disconnection when using request by docker
library, it's not affect script execution, therefore ignore them first.
2. Replication tests failed in nightly due to new UI code, some element
locators are not valid anymore;
3. Remove switch scanner test steps, since Clair was removed.
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-11-10 10:04:46 +08:00
danfengliu
8285db8def
Replication UI changes break upgrade pipeline
...
Remove duplicate keyword for editing replication rule.
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-10-14 11:00:14 +08:00
AllForNothing
3f213df595
Fix nightly case for replication
...
Signed-off-by: AllForNothing <sshijun@vmware.com>
2020-09-30 16:59:11 +08:00
Will Sun
18f41bad88
Merge pull request #13085 from AllForNothing/replication
...
Add disable/enable function to replication rules
2020-09-24 17:35:51 +08:00
danfengliu
ef53edf553
Recovery nightly setup
...
1. Recovery nightly setup;
2. Add retry for replication rule selection.
3. Add retry for CNAB test.
4. Rerun keyword of push CNAB
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-09-22 02:41:50 +00:00
AllForNothing
abdbd79ed4
Add disable/enable function to replication rules
...
Signed-off-by: AllForNothing <sshijun@vmware.com>
2020-09-17 10:29:31 +08:00
danfengliu
3b8a2890f9
Upgrade robot-framework and Selenium library
...
1. Upgrade robot-framework to 3.1 and Selenium library to 4.4.0.
2. Fix a registry issue for clear filter text input.
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-08-06 07:25:53 +00:00
danfengliu
8328e95b63
Add GCS&S3 push-based replicatiton tests
...
1. Add GCS push-based replicatiton tests;
There is an issue against it, so it's commented out;
2. Add S3 push-based replicatiton tests;
3. Add filter registry keyword;
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-07-29 12:44:49 +00:00
danfengliu
8a691c5df1
Add OIDC user onboard test in nightly
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-07-27 13:56:18 +08:00
danfengliu
e20cb51d6b
Fix issues in replication tests
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-07-20 09:42:55 +08:00
danfengliu
aa43afb601
Add push-based replication test in nightly
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-07-16 19:50:42 +08:00
danfengliu
ceaa0a57b3
Add replication schedule test
...
1. Add replication schedule test;
2. Add some sleep after project creation before push image to avoid push image v2 error.
It fixed issue# 12094: Scan image vmware/photon:1.0 return unsupported occasionally.
3. Add some sleep in test_user_view_logs.py, can't get operation logs sometimes.
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-06-02 15:51:10 +08:00
danfengliu
5d8a308158
Add retry for keyword go into index
...
1. Add retry for keyword go into index;
2. Add retry for keyword go into project.
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-05-27 08:55:58 +00:00
Danfeng Liu (c)
ea01a236a5
Add retry when fail to find replication
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2020-01-08 17:08:42 +08:00
Danfeng Liu (c)
76cbcfcbb9
Refect upgrade script, population will be distinguished by harbor version.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-12-26 14:08:47 +08:00
Danfeng Liu (c)
1698cc034a
Add a replication scope keyword for waiting the completion fo replication result. All replication test case must use this keyword to verify if image was pulled.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-27 15:51:03 +08:00
Danfeng Liu (c)
d8c49d9834
Replication rule element is modified from selector to input, so nightly test case should be updated.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-01 13:08:47 +08:00
Danfeng Liu (c)
5d1913842c
Script test case for project quotas, there will be 2 or 3 test cases in this PR, like project quota edit, prject quota functionality.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-18 17:55:25 +08:00
Yogi_Wang
a7c7a8e675
Upgrade angualr from 7.1.3 to 8.2.0 and clarity from 1.0 to 2.2
...
Signed-off-by: Yogi_Wang <yawang@vmware.com>
Signed-off-by: Meina Zhou <meinaz@vmware.com>
Signed-off-by: sshijun <sshijun@vmware.com>
2019-09-18 10:12:20 +08:00
danfengliu
7d681c623b
Add AWS-ECR and Google-GCR replication test into nighly tests.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-02 17:53:49 +08:00
danfengliu
b7803571d4
Currently, nightly test pipeline was only in one level category of auth_mode and upgrade, now we like to add a level base on the original level which is harbor deployment parameters. ( #8398 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-01 15:10:54 +08:00
danfengliu
d8b76c482a
Add 2 UI test cases which is replication rule edit and delete. ( #7904 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-06-03 16:58:24 +08:00
danfengliu
8a2ee784a4
Missing modification in keyword <Create A New Endpoint>, due to changing of docker-hub select item, it must be modified. ( #7754 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-10 14:24:12 +08:00
danfengliu
dffb2bbd98
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case <Replication Of Pull Images from DockerHub To Self> and <Replication Of Push Images from Self To Harbor> has been finished and ready for duty. Other modification is add retry for keywords in UserProfile.robot ( #7611 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-09 15:44:48 +08:00
danfengliu
c4fbcb481e
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here is that test case endpoint add/edit/delete have been finished and ready for duty. ( #7496 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-24 11:20:26 +08:00
danfengliu
c3c10a87b2
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case add-replication-test-case-Endpoint-Verification has been finished and ready for duty. ( #7472 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-23 15:33:04 +08:00
danfengliu
4e8d4fca85
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipline, and here test case Pro-Replication-Rules-Add has been finished and ready for duty. ( #7453 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-22 09:58:02 +08:00
danfengliu
e12fd13c56
Encapsulate keyword <element click> and add it into keyword <Go Back To Versions And Delete>, this porblem caused case failure of <List Helm Charts> randomly. ( #6834 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-30 14:22:31 +08:00
Meina Zhou
b68dd47a20
modify test case since replication log change to popup a new page
...
Signed-off-by: Meina Zhou <meinaz@vmware.com>
2018-10-26 16:20:00 +08:00
clouderati
587459df15
Replacing copyright notices with "Copyright Project Harbor Authors".
...
Signed-off-by: clouderati <35942204+clouderati@users.noreply.github.com>
2018-09-19 16:59:36 +00:00
sigsbee
a6f14c6d89
Update test case to increase passrate ( #5083 )
...
Update test case order to avoid scan on push fail
Add sleep time to avoid view scan results fail
Change keyword to wait unitl avoid delete operation fail
Change delete rule and repicate manual confirm to mouse down and up
2018-06-05 18:51:11 +08:00
sigsbee
a0bf7196e6
Fix label test case and replicate case ( #5075 )
...
Fix label test case fail for new UI change
Fix replicate manual keyword to avoid case fail
2018-06-02 01:34:33 +08:00