Danfeng Liu (c)
f0750f73de
1. Add element verification for keyword Go Into Project; Make big loop effective by stop assert in keyword Retry Double Keywords When Error; 2. Quota string verification is too restrictive, make it loose a little.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-25 17:44:15 +08:00
Danfeng Liu (c)
b8a7598ffa
The criteria of keyword Go Into Project is not strong for verify if it's in project repositroy page, so fix this issue by way of 'Retry Double Keywords When Error'.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-22 12:07:20 +08:00
sshijun
14364727ae
Nightly case for tag-retention
...
Signed-off-by: sshijun <sshijun@vmware.com>
2019-11-11 16:58:33 +08:00
Yogi_Wang
58936aae42
Modify nightly case of scanner
...
Signed-off-by: Yogi_Wang <yawang@vmware.com>
2019-11-11 13:19:37 +08:00
Yogi_Wang
988279cdcb
Add webhook nightly case
...
Signed-off-by: Yogi_Wang <yawang@vmware.com>
2019-10-25 15:25:32 +08:00
danfengliu
ac0d3c991a
Add nightly test case of 'Retag should be forbidden when system configuration read-only mode was set'.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-10-10 17:13:19 +08:00
danfengliu
feeb6fb2d8
1. Nightly test case failed due to more vulnerbility CVE IDs in image redis, so add 2 new CVE IDs in CVE Whitelist test cases. 2. A Keyword parameter error was fixed in this PR.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-10-02 16:43:50 +08:00
Danfeng Liu (c)
20dc245631
In nightly helm pipeline, test case 'Project Quotas Control Under GC' failed, it should be timing issue that the valuse in UI is not ready, so I add a keyword 'Retry Keyword When Return Value Mismatch' to retry value getting action.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-25 17:02:05 +08:00
Danfeng Liu (c)
5d1913842c
Script test case for project quotas, there will be 2 or 3 test cases in this PR, like project quota edit, prject quota functionality.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-18 17:55:25 +08:00
danfengliu
7d681c623b
Add AWS-ECR and Google-GCR replication test into nighly tests.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-02 17:53:49 +08:00
danfengliu
7217ed5358
Add CVE Whitelist test cases into nightly test, first test case is system CVE Whitelist test.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-28 14:01:43 +08:00
danfengliu
6818ce9b06
Adding retry for wait element visibility, in nightly test case Developer-Operate-Labels, project didn't show up when checking its visiblity, so add some wait for this check. ( #8554 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-05 16:13:39 +08:00
danfengliu
01e3175647
In nightly test, there're some element click error occured in a rare occasion, so add a sleep to give it a try. ( #8428 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-07-29 13:37:02 +08:00
danfengliu
a8300d91e6
Add a nightly test case helm CLI, in this case, we verify help repo add and helm push. ( #8240 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-07-16 14:00:30 +08:00
danfengliu
432d0757f0
In nightly test, case Disable-Scan-Schedule always failed at action of edit button click, so we should add a comfirmation to make sure that this button will be disappeared after click action. ( #8126 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-06-24 18:09:34 +08:00
danfengliu
74d39afbb0
Modify robot-framework keyword <Retry Double Keywords When Error>, when the second action is success, should quit keyword.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-06-18 16:40:11 +08:00
danfengliu
d8b76c482a
Add 2 UI test cases which is replication rule edit and delete. ( #7904 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-06-03 16:58:24 +08:00
danfengliu
e66d857fbc
Add test case secret-verify for oidc-auth-mode feature by adding some keywords and one test cases.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-27 14:31:14 +08:00
danfengliu
a503944110
OIDC authentication is a new feature in version 1.8.0, so add nightly GUI test cases for OIDC authentication scenario. ( #7745 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-22 11:19:08 +08:00
danfengliu
dffb2bbd98
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case <Replication Of Pull Images from DockerHub To Self> and <Replication Of Push Images from Self To Harbor> has been finished and ready for duty. Other modification is add retry for keywords in UserProfile.robot ( #7611 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-09 15:44:48 +08:00
danfengliu
c320645ba1
many keywords in ToolKit.robot miss wait or retry when operating elements, and it has cause test case failure one time, so I modify all keywords in ToolKit.robot. ( #7340 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-11 15:15:35 +08:00
danfengliu
7c0273e5f9
Add a checkpoint in the end of key word <Add Guest Member To Project>, to make sure that the confirm button was click successfully, to see if this confirm button was dissappered after clicked. ( #7320 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-09 13:41:56 +08:00
danfengliu
3db3f3a62e
add test cases for jenkins upgrade project, wrap test cases body into new keywords, so that case body appears only in one single place ( #7243 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-28 14:37:03 +08:00
danfengliu
8089ee10ce
add a checkpoint for keyword-Add-Guest-Member-To-Project to make sure the OK button has disapeared, the the following action will not be blocked ( #7151 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-15 17:18:44 +08:00
danfengliu
a618a2c2ac
Button was not clicked successfully in keyword < Delete Repo>, but the click action returned pass, so I add a checkpoint after clicking the delete button, make sure the pop info had disappeared, it means delete button was clicked successfully. ( #7071 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-11 10:34:53 +08:00
danfengliu
a9b27b0071
In nightly test, 2 errors occurred, chrome webdrive initializtion failed, and delete repoitory on card view failed too, so add a retry for ffailure and add some sleep. ( #7012 )
...
Add retry in keyword "Delete Repo".
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-02-26 13:37:16 +08:00
danfengliu
a1063edae6
Add GUI test script for new feature of master-role, without adding a new case for master-role, I add new test steps in old test case named Manage-Project-Members, because master-role is a sub function in project members. ( #6945 )
...
In this PR, I also modify a public action keyword to make it suitble for indefinite numbers of parameters.
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-02-22 14:11:56 +08:00
danfengliu
275a917dbf
add Capture Page Screenshot in retry keyword ( #6897 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-02-13 14:48:09 +08:00
danfengliu
47530cd62e
remove some sleep and add retry common keyword ( #6875 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-31 17:58:05 +08:00
danfengliu
e5efbfe490
add retry keyword for docker pull and push image command. ( #6857 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-31 16:08:58 +08:00
danfengliu
e12fd13c56
Encapsulate keyword <element click> and add it into keyword <Go Back To Versions And Delete>, this porblem caused case failure of <List Helm Charts> randomly. ( #6834 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-30 14:22:31 +08:00
danfengliu
9aeb626fe3
The former way to verify project creation is by API calling, but it's not a GUI operation, which is not a goal for operator, so I replace it with GUI verification ( #6816 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-28 16:32:45 +08:00
danfengliu
b0c1adab8d
add retry for make swagger client ( #6813 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-24 17:09:32 +08:00
danfengliu
73b9e95464
Add wait until in <Multi-delete Object> and <Project Should Display>
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-14 15:19:30 +08:00
FangyuanCheng
34dee765ec
Add E2E test for retag
...
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
2018-11-19 12:20:19 +08:00
Wenkai Yin
40f8f4bc5d
Check the vul data before running scan-on-push case
...
Update the automation case to wait until the vul data is ready before running the scan-on-push case
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-11-02 17:54:47 +08:00
Wenkai Yin
00acb507ba
Update automation test cases
...
Update the case to pass nightly testing for Harbor chart
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-10-11 15:29:43 +08:00
clouderati
587459df15
Replacing copyright notices with "Copyright Project Harbor Authors".
...
Signed-off-by: clouderati <35942204+clouderati@users.noreply.github.com>
2018-09-19 16:59:36 +00:00
Qian Deng
4d601292d1
Add E2E test for helmchart ( #5746 )
...
Add E2E test for helmchart repo
Signed-off-by: Qian Deng <dengq@vmware.com>
2018-09-04 15:08:51 +08:00
Daniel Jiang
0a07f0e039
Merge pull request #5402 from stonezdj/api_test
...
Add harbor API test
2018-08-06 17:30:07 +08:00
stonezdj
edcb2fbf05
Add Harbor API Test based on python API
...
Correct swagger.yaml format
Add make task swagger_client to gen and install python client.
Add LDAP related Test
2018-08-01 10:43:23 +08:00
wangyan
5edd408d07
Add scripts to verify Harbor DB migration
2018-07-30 04:54:33 -07:00
Yan
85ded71816
Update e2e cases
...
refactor e2e test cases to support new CI pipeline
fix issues caused by recently UI change
2018-07-19 02:22:03 -07:00
wangyan
28a13db29a
Fix CI pipeline bug on packaging offline installer
2018-07-03 08:42:26 -07:00
sigsbee
889b36a944
Add data verify robot case after upgrade ( #5207 )
...
Add data verify e2e case after upgrade
2018-06-29 15:01:26 +08:00
sigsbee
9baee6b88c
Add LDAP case and add delay to project config to avoid case fail ( #4486 )
...
* Add LDAP case and add delay to project config to avoid case fail
2018-03-28 16:45:49 +08:00
sigsbee
4ccd7e7cdf
Add vulneraibility case and add a testcase doc. ( #4378 )
...
Add disable schedule
vulnerability data not ready
can as an unprivileged user
scan image with empty vul
manual scan all
project level image serverity policy
scan on push
2018-03-12 14:20:37 +08:00
Yan
bb66a0cb52
Add harbor nightly and longevity test ( #3940 )
2018-01-23 13:04:19 +08:00
sigsbee
bf14cf4436
Add batch delete testcase ( #3981 )
2018-01-12 10:42:17 +08:00
myufei
c66ab0d142
Add project level policy auto case
2017-11-07 15:04:27 +08:00