Commit Graph

54 Commits

Author SHA1 Message Date
danfengliu
718bec97ef Fix OIDC tests issue for new dex service
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-05-31 17:50:36 +08:00
danfengliu
0e752d8cf8 Add docker credential for harbor 1.10.0 and fix docker api issue
1. Move LDAP API test out of robot script, LDAP API test will be triggered in Jenkins job independently;
2. Docker api returned from function before analyze the return message for expected error.

Signed-off-by: danfengliu <danfengl@vmware.com>
2021-01-11 14:06:25 +08:00
Danfeng Liu (c)
3def601f7c Close scan plugin popup message to avoid interfereing logout operation
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2020-04-03 11:47:17 +08:00
danfengliu
9e42f6d6d1 Notary test failed in Helm Pipeline
In Helm pipeline, harbor access address is by domain name instead of IP, so cert directory should be created by domain name.

Signed-off-by: danfengliu <danfengl@vmware.com>
2020-01-20 17:13:17 +08:00
Danfeng Liu (c)
9b51123bd3 1. Add nightly test case of Robot-Account; 2. In Go Into Repo keyword, filter element should not be clicked since list in loading state, so add some sleep and waiting for the cirlce icon is gone; 3. Move read-only test case in the end of common.robot.
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2020-01-19 14:51:35 +08:00
sshijun
14364727ae Nightly case for tag-retention
Signed-off-by: sshijun <sshijun@vmware.com>
2019-11-11 16:58:33 +08:00
Yogi_Wang
58936aae42 Modify nightly case of scanner
Signed-off-by: Yogi_Wang <yawang@vmware.com>
2019-11-11 13:19:37 +08:00
Yogi_Wang
988279cdcb Add webhook nightly case
Signed-off-by: Yogi_Wang <yawang@vmware.com>
2019-10-25 15:25:32 +08:00
danfengliu
ac0d3c991a Add nightly test case of 'Retag should be forbidden when system configuration read-only mode was set'.
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-10-10 17:13:19 +08:00
danfengliu
feeb6fb2d8 1. Nightly test case failed due to more vulnerbility CVE IDs in image redis, so add 2 new CVE IDs in CVE Whitelist test cases. 2. A Keyword parameter error was fixed in this PR.
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-10-02 16:43:50 +08:00
Danfeng Liu (c)
20dc245631 In nightly helm pipeline, test case 'Project Quotas Control Under GC' failed, it should be timing issue that the valuse in UI is not ready, so I add a keyword 'Retry Keyword When Return Value Mismatch' to retry value getting action.
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-25 17:02:05 +08:00
Danfeng Liu (c)
5d1913842c Script test case for project quotas, there will be 2 or 3 test cases in this PR, like project quota edit, prject quota functionality.
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-18 17:55:25 +08:00
danfengliu
7d681c623b Add AWS-ECR and Google-GCR replication test into nighly tests.
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-02 17:53:49 +08:00
danfengliu
7217ed5358 Add CVE Whitelist test cases into nightly test, first test case is system CVE Whitelist test.
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-28 14:01:43 +08:00
danfengliu
6818ce9b06
Adding retry for wait element visibility, in nightly test case Developer-Operate-Labels, project didn't show up when checking its visiblity, so add some wait for this check. (#8554)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-05 16:13:39 +08:00
danfengliu
01e3175647
In nightly test, there're some element click error occured in a rare occasion, so add a sleep to give it a try. (#8428)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-07-29 13:37:02 +08:00
danfengliu
a8300d91e6
Add a nightly test case helm CLI, in this case, we verify help repo add and helm push. (#8240)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-07-16 14:00:30 +08:00
danfengliu
432d0757f0
In nightly test, case Disable-Scan-Schedule always failed at action of edit button click, so we should add a comfirmation to make sure that this button will be disappeared after click action. (#8126)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-06-24 18:09:34 +08:00
danfengliu
74d39afbb0 Modify robot-framework keyword <Retry Double Keywords When Error>, when the second action is success, should quit keyword.
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-06-18 16:40:11 +08:00
danfengliu
d8b76c482a
Add 2 UI test cases which is replication rule edit and delete. (#7904)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-06-03 16:58:24 +08:00
danfengliu
e66d857fbc Add test case secret-verify for oidc-auth-mode feature by adding some keywords and one test cases.
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-27 14:31:14 +08:00
danfengliu
a503944110
OIDC authentication is a new feature in version 1.8.0, so add nightly GUI test cases for OIDC authentication scenario. (#7745)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-22 11:19:08 +08:00
danfengliu
dffb2bbd98 Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case <Replication Of Pull Images from DockerHub To Self> and <Replication Of Push Images from Self To Harbor> has been finished and ready for duty. Other modification is add retry for keywords in UserProfile.robot (#7611)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-09 15:44:48 +08:00
danfengliu
c320645ba1
many keywords in ToolKit.robot miss wait or retry when operating elements, and it has cause test case failure one time, so I modify all keywords in ToolKit.robot. (#7340)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-11 15:15:35 +08:00
danfengliu
7c0273e5f9
Add a checkpoint in the end of key word <Add Guest Member To Project>, to make sure that the confirm button was click successfully, to see if this confirm button was dissappered after clicked. (#7320)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-09 13:41:56 +08:00
danfengliu
3db3f3a62e
add test cases for jenkins upgrade project, wrap test cases body into new keywords, so that case body appears only in one single place (#7243)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-28 14:37:03 +08:00
danfengliu
8089ee10ce
add a checkpoint for keyword-Add-Guest-Member-To-Project to make sure the OK button has disapeared, the the following action will not be blocked (#7151)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-15 17:18:44 +08:00
danfengliu
a618a2c2ac
Button was not clicked successfully in keyword < Delete Repo>, but the click action returned pass, so I add a checkpoint after clicking the delete button, make sure the pop info had disappeared, it means delete button was clicked successfully. (#7071)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-11 10:34:53 +08:00
danfengliu
a9b27b0071 In nightly test, 2 errors occurred, chrome webdrive initializtion failed, and delete repoitory on card view failed too, so add a retry for ffailure and add some sleep. (#7012)
Add retry in keyword "Delete Repo".

Signed-off-by: danfengliu <danfengl@vmware.com>
2019-02-26 13:37:16 +08:00
danfengliu
a1063edae6
Add GUI test script for new feature of master-role, without adding a new case for master-role, I add new test steps in old test case named Manage-Project-Members, because master-role is a sub function in project members. (#6945)
In this PR, I also modify a public action keyword to make it suitble for indefinite numbers of parameters.

Signed-off-by: danfengliu <danfengl@vmware.com>
2019-02-22 14:11:56 +08:00
danfengliu
275a917dbf add Capture Page Screenshot in retry keyword (#6897)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-02-13 14:48:09 +08:00
danfengliu
47530cd62e
remove some sleep and add retry common keyword (#6875)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-31 17:58:05 +08:00
danfengliu
e5efbfe490
add retry keyword for docker pull and push image command. (#6857)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-31 16:08:58 +08:00
danfengliu
e12fd13c56
Encapsulate keyword <element click> and add it into keyword <Go Back To Versions And Delete>, this porblem caused case failure of <List Helm Charts> randomly. (#6834)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-30 14:22:31 +08:00
danfengliu
9aeb626fe3
The former way to verify project creation is by API calling, but it's not a GUI operation, which is not a goal for operator, so I replace it with GUI verification (#6816)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-28 16:32:45 +08:00
danfengliu
b0c1adab8d
add retry for make swagger client (#6813)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-24 17:09:32 +08:00
danfengliu
73b9e95464 Add wait until in <Multi-delete Object> and <Project Should Display>
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-14 15:19:30 +08:00
FangyuanCheng
34dee765ec Add E2E test for retag
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
2018-11-19 12:20:19 +08:00
Wenkai Yin
40f8f4bc5d Check the vul data before running scan-on-push case
Update the automation case to wait until the vul data is ready before running the scan-on-push case

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-11-02 17:54:47 +08:00
Wenkai Yin
00acb507ba Update automation test cases
Update the case to pass nightly testing for Harbor chart

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-10-11 15:29:43 +08:00
clouderati
587459df15 Replacing copyright notices with "Copyright Project Harbor Authors".
Signed-off-by: clouderati <35942204+clouderati@users.noreply.github.com>
2018-09-19 16:59:36 +00:00
Qian Deng
4d601292d1 Add E2E test for helmchart (#5746)
Add E2E test for helmchart repo

Signed-off-by: Qian Deng <dengq@vmware.com>
2018-09-04 15:08:51 +08:00
Daniel Jiang
0a07f0e039
Merge pull request #5402 from stonezdj/api_test
Add harbor API test
2018-08-06 17:30:07 +08:00
stonezdj
edcb2fbf05 Add Harbor API Test based on python API
Correct swagger.yaml format
Add make task swagger_client to gen and install python client.
Add LDAP related Test
2018-08-01 10:43:23 +08:00
wangyan
5edd408d07 Add scripts to verify Harbor DB migration 2018-07-30 04:54:33 -07:00
Yan
85ded71816 Update e2e cases
refactor e2e test cases to support new CI pipeline
fix issues caused by recently UI change
2018-07-19 02:22:03 -07:00
wangyan
28a13db29a Fix CI pipeline bug on packaging offline installer 2018-07-03 08:42:26 -07:00
sigsbee
889b36a944
Add data verify robot case after upgrade (#5207)
Add data verify e2e case after upgrade
2018-06-29 15:01:26 +08:00
sigsbee
9baee6b88c
Add LDAP case and add delay to project config to avoid case fail (#4486)
* Add LDAP case and add delay to project config to avoid case fail
2018-03-28 16:45:49 +08:00
sigsbee
4ccd7e7cdf
Add vulneraibility case and add a testcase doc. (#4378)
Add disable schedule 
vulnerability data not ready 
can as an unprivileged user 
scan image with empty vul 
manual scan all
project level image serverity policy 
scan on push
2018-03-12 14:20:37 +08:00