Upstream/harbor
1
0
Fork 0
mirror of https://github.com/goharbor/harbor.git synced 2024-11-19 00:36:02 +01:00
Code Issues Projects Releases Wiki Activity
8,897 Commits 54 Branches 316 Tags 351 MiB
ae7834af0b
Commit Graph

216 Commits

Author SHA1 Message Date
danfengliu
8503957eac 1.Add CVE white list API test into API_DB.robot;2.Random data for prject name should use lower case %m%s;3.Replace from harbor to self. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-09-04 15:50:09 +08:00
danfengliu
7d681c623b Add AWS-ECR and Google-GCR replication test into nighly tests. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-09-02 17:53:49 +08:00
danfengliu
7217ed5358 Add CVE Whitelist test cases into nightly test, first test case is system CVE Whitelist test. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-08-28 14:01:43 +08:00
danfengliu
6818ce9b06
Adding retry for wait element visibility, in nightly test case Developer-Operate-Labels, project didn't show up when checking its visiblity, so add some wait for this check. (#8554) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-08-05 16:13:39 +08:00
danfengliu
b7803571d4
Currently, nightly test pipeline was only in one level category of auth_mode and upgrade, now we like to add a level base on the original level which is harbor deployment parameters. (#8398) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-08-01 15:10:54 +08:00
danfengliu
a31d12e01e
modify xpath of project member due to summary tab was added in project. (#8421) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-07-26 17:18:47 +08:00
danfengliu
554b0771fe
Due to adding new feature for white list, xpath of configuration changed, it caused failure of nightly tests, so it should be fixed. (#8307) 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-07-17 16:46:26 +08:00
danfengliu
9b61bf4fce
In nightly test case 'list helm chart', delete chart (#8280) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-07-17 15:32:10 +08:00
danfengliu
a8300d91e6
Add a nightly test case helm CLI, in this case, we verify help repo add and helm push. (#8240) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-07-16 14:00:30 +08:00
danfengliu
db012c816d
In nightly test case <Delete Multi Member>, 'action' was clicked, but the dropdown list was't not shown up, so we should add a comfirmation to make sure the expected element show up. (#8146) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-07-08 15:28:28 +08:00
danfengliu
432d0757f0
In nightly test, case Disable-Scan-Schedule always failed at action of edit button click, so we should add a comfirmation to make sure that this button will be disappeared after click action. (#8126) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-06-24 18:09:34 +08:00
danfengliu
a9998adfae In robot-framework, Element Clicked returns OK, but the element was not click functionally 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-06-17 16:12:38 +08:00
danfengliu
d8b76c482a
Add 2 UI test cases which is replication rule edit and delete. (#7904) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-06-03 16:58:24 +08:00
danfengliu
e66d857fbc Add test case secret-verify for oidc-auth-mode feature by adding some keywords and one test cases. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-27 14:31:14 +08:00
danfengliu
a2b651969c
Fix bug for manage-project-member, due to keywords changed for oidc-auth-mode, test case manage-project-member should be debug at the same time. (#7888) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-24 15:22:28 +08:00
danfengliu
fed310a974
Add test case for oidc auth mode (#7860) 
* Nightly test case user-view-logs failed several times, after debugging, the reason is checking too fast although the operation has not finsished, so I add a checking for end of the operation.

Signed-off-by: danfengliu <danfengl@vmware.com>

* Add test case Manage-Project-Member for oidc auth mode Jenkins pipeline, this test case reuse the same test case in common file.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-23 15:43:59 +08:00
danfengliu
7b7f7a920a
Nightly test case user-view-logs failed several times, after debugging, the reason is checking too fast although the operation has not finsished, so I add a checking for end of the operation. (#7858) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-22 14:06:07 +08:00
danfengliu
a503944110
OIDC authentication is a new feature in version 1.8.0, so add nightly GUI test cases for OIDC authentication scenario. (#7745) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-22 11:19:08 +08:00
danfengliu
8a2ee784a4
Missing modification in keyword <Create A New Endpoint>, due to changing of docker-hub select item, it must be modified. (#7754) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-10 14:24:12 +08:00
danfengliu
dffb2bbd98 Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case <Replication Of Pull Images from DockerHub To Self> and <Replication Of Push Images from Self To Harbor> has been finished and ready for duty. Other modification is add retry for keywords in UserProfile.robot (#7611) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-09 15:44:48 +08:00
danfengliu
c4fbcb481e
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here is that test case endpoint add/edit/delete have been finished and ready for duty. (#7496) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-04-24 11:20:26 +08:00
danfengliu
c3c10a87b2
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case add-replication-test-case-Endpoint-Verification has been finished and ready for duty. (#7472) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-04-23 15:33:04 +08:00
danfengliu
6b9584a71f
Add retry and wait for keyword <View Repo Scan Details>, Jenkins chart CI failed at 1 test case in rare occasion, the reason is lacking of wait and retry to wait. (#7466) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-04-22 15:47:43 +08:00
danfengliu
4e8d4fca85
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipline, and here test case Pro-Replication-Rules-Add has been finished and ready for duty. (#7453) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-04-22 09:58:02 +08:00
danfengliu
887694019e
Sign-in element xpath has changed, so it need to be modified to the new one. (#7355) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-04-12 16:15:23 +08:00
danfengliu
c320645ba1
many keywords in ToolKit.robot miss wait or retry when operating elements, and it has cause test case failure one time, so I modify all keywords in ToolKit.robot. (#7340) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-04-11 15:15:35 +08:00
danfengliu
7c0273e5f9
Add a checkpoint in the end of key word <Add Guest Member To Project>, to make sure that the confirm button was click successfully, to see if this confirm button was dissappered after clicked. (#7320) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-04-09 13:41:56 +08:00
danfengliu
0e0c691225
In project.robot, many element click or other action keywords missing retry, it will cause innessesary sleep in scripts. (#7274) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-04-09 10:44:24 +08:00
jwangyangls
a27df46fb6
Merge pull request #7292 from jwangyangls/fix_login_robot_issue 
Fix nightly test case failed when login harbor.
 2019-04-04 12:14:43 +08:00
Yogi_Wang
4416e1810e fix login harbor issue with test case 
Solve the problem that when we log on to the harbor page, the automation test will click on an incorrect button, which results in the test page being unable to log in.

Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-04-04 09:58:46 +08:00
FangyuanCheng
82716d492d move vulnerability and gc ui 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-03 14:39:46 +08:00
danfengliu
6b19b99c97
test case Disable Scan Schedule failed at page should contain part, it missing wait until and retry, so add one (#7228) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-27 15:33:31 +08:00
FangyuanCheng
dada47c07e Refactoring vulnerability ui support cron 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-03-23 20:58:45 +08:00
danfengliu
d9eb519e6c
Test case <List Helm Charts> failed occasionally, due to lacking of wail and retry for action word, so this case need to be refected. (#7165) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-18 18:06:46 +08:00
danfengliu
8089ee10ce
add a checkpoint for keyword-Add-Guest-Member-To-Project to make sure the OK button has disapeared, the the following action will not be blocked (#7151) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-15 17:18:44 +08:00
danfengliu
eda6bbf8e6 add checkpoint for keyword Go Into Repo to make sure the tag in repository shown up completly. (#7142) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-14 18:38:08 +08:00
danfengliu
a618a2c2ac
Button was not clicked successfully in keyword < Delete Repo>, but the click action returned pass, so I add a checkpoint after clicking the delete button, make sure the pop info had disappeared, it means delete button was clicked successfully. (#7071) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-11 10:34:53 +08:00
danfengliu
62bb10d2e4
Nightly test case <List Helm Charts> is not stable, due to keyword <Go Back To Versions And Delete> failed at delete button click on a rare occasion, so I wrap 2 related action into one transaction, it does help. (#7050) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-01 18:25:45 +08:00
danfengliu
4dc983d419 In nightly tests, keyword <Multi Delete Object> failed on a rare occasion, so add retry for elemnet click in this keyword. (#7022) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-02-26 18:43:24 +08:00
danfengliu
a9b27b0071 In nightly test, 2 errors occurred, chrome webdrive initializtion failed, and delete repoitory on card view failed too, so add a retry for ffailure and add some sleep. (#7012) 
Add retry in keyword "Delete Repo".

Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-02-26 13:37:16 +08:00
danfengliu
c7d1e18477
In Nightly-CI keyword <Delete Repo> failed on the rare occasion. The appearance is that the repo check-box is not checked, although Click action keyword returned success, it effected the following actions. (#7003) 
For now, add a sleep to make it a try, and also add Capture Page Screenshot for debugging.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-02-25 10:48:04 +08:00
danfengliu
a1063edae6
Add GUI test script for new feature of master-role, without adding a new case for master-role, I add new test steps in old test case named Manage-Project-Members, because master-role is a sub function in project members. (#6945) 
In this PR, I also modify a public action keyword to make it suitble for indefinite numbers of parameters.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-02-22 14:11:56 +08:00
jwangyangls
3d726219e5
Merge pull request #6758 from jwangyangls/privilege_escalation 
user permission change and add master role
 2019-01-31 18:57:22 +08:00
System Administrator
1a551690d3 promission reset 
Signed-off-by: Yogi_Wang <wang1084@126.com>
 2019-01-31 18:06:49 +08:00
danfengliu
e5efbfe490
add retry keyword for docker pull and push image command. (#6857) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-31 16:08:58 +08:00
danfengliu
e12fd13c56
Encapsulate keyword <element click> and add it into keyword <Go Back To Versions And Delete>, this porblem caused case failure of <List Helm Charts> randomly. (#6834) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-30 14:22:31 +08:00
danfengliu
9aeb626fe3
The former way to verify project creation is by API calling, but it's not a GUI operation, which is not a goal for operator, so I replace it with GUI verification (#6816) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-28 16:32:45 +08:00
danfengliu
257eebfebe
Add space adaptor for regexp when create a new project, we loose the criteria to match the project name because the return json datat may be shown in different lines . (#6768) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-24 09:38:46 +08:00
danfengliu
f29960628a Keyword <Go Into Project> has modified, but verify.robot didn't adapt this keyword. 
Modifications:
	1.Add paramenter hasimage in data.json
	2.Modify Harbor-Pages\Verify.robot to pass it to <Go Into Project>
	3.Add loop and exception-catch in <Go Into Project> to prevent using Sleep and failure by exception(this exception was caused by short time of paga loading)

Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-17 17:46:17 +08:00
danfengliu
fd5e109583 add wait until in keyword <Create An New Project> 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-15 17:46:46 +08:00
danfengliu
73b9e95464 Add wait until in <Multi-delete Object> and <Project Should Display> 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-14 15:19:30 +08:00
danfengliu
0b27037e34
Two modifications in PR:1. Due to GUI change on position of "project creation" configuration, script must be adjust with the corresponding change; 2. Fixed a issue of no exception caught when http request has error, all the system config will be set by a common request function. (#6715) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-11 13:40:08 +08:00
System Administrator
27c180bf20 fix_bug 
Signed-off-by: Yogi_Wang <wang1084@126.com>
 2019-01-11 11:00:46 +08:00
Wenkai Yin
60a58cba11
Merge pull request #6619 from danfengliu/robot-script-refector-of-sign-in-harbor 
Robot script refactor for keyword sign-in-harbor
 2019-01-10 13:42:15 +08:00
jwangyangls
07ad9d1dd5
Merge pull request #6701 from jwangyangls/upgrade_clr_1.0.3_issue 
Upgrade clr 1.0.0 issue
 2019-01-08 14:17:17 +08:00
danfengliu
d853adce46 Robot scripts refactor for keyword sign-in-harbor and other few keywords, mainly on replacing 'sleep' to 'wait until', and also add a checkpoint in "Go Into Project" keyword to verify the result of loading a project page. 
Modify Switch To Log and Back To projects
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-08 13:44:14 +08:00
Yogi_Wang
10d74eabd7 upgrade clarity components to 1.0 and fix issue 
Signed-off-by: Yogi_Wang <Yogiwang@Yogi-WangdeMacBook-Pro.local>
 2019-01-08 12:50:26 +08:00
FangyuanCheng
55e868bd9f fix test case for project link 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-01-08 11:28:03 +08:00
Yogi_Wang
aee07fff96 upgrade clarity components to 1.0 
Signed-off-by: Yogi_Wang <Yogiwang@Yogi-WangdeMacBook-Pro.local>
 2019-01-03 10:32:52 +08:00
FangyuanCheng
9a52059e89 fix nightly test of retag 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2018-12-21 17:34:15 +08:00
Meina Zhou
7827f19671 quick fix for scan log 
This is a quick fix

Signed-off-by: Meina Zhou <meinaz@vmware.com>
 2018-12-07 12:29:15 +08:00
Qian Deng
7d4de8743b Fix: Rebotcase failure in upload chart (#6411) 
Fix testcase because of wrong keyword

Signed-off-by: Qian Deng <dengq@vmware.com>
 2018-12-03 18:49:07 +08:00
Qian Deng
9dd509e0eb Fix xpath in go to project robot case 
Global search bug fix introduced test case failure, fix it by edit xpath

Signed-off-by: Qian Deng <dengq@vmware.com>
 2018-11-30 15:33:14 +08:00
Mia ZHOU
3c000f10a0
Merge pull request #6338 from ninjadq/fix_chart_ui_related_issues 
Fix chart ui related issues
 2018-11-29 10:11:44 +08:00
Qian Deng
8ca917291e Fix: upload chart version testcase failure in nightly 
This is because after 2 seconds the modal still exist

Signed-off-by: Qian Deng <dengq@vmware.com>
 2018-11-23 17:03:15 +08:00
FangyuanCheng
e7b8fb8f04 Add E2E test for build history 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2018-11-20 13:39:57 +08:00
FangyuanCheng
34dee765ec Add E2E test for retag 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2018-11-19 12:20:19 +08:00
Qian Deng
c716ebba59 Fix testcase of helm chart delete 
Fix delete helm chart testcase

Signed-off-by: Qian Deng <dengq@vmware.com>
 2018-11-15 11:11:14 +08:00
Qian Deng
6d1163f592 Fix: Nightly test fail from time to time 
Sometimes the time span of back to helm chart list is longer then 2 seconds.

Signed-off-by: Qian Deng <dengq@vmware.com>
 2018-11-13 17:22:12 +08:00
Mia ZHOU
08081d38fa modify test ldap button xpath (#6236) 
Signed-off-by: Meina Zhou <meinaz@vmware.com>
 2018-11-08 13:44:13 +08:00
Wenkai Yin
55c609b1a7 Update automation test case (#6221) 
1. Add "Wait Until ..." to "Change User Role In Project"
2. Rename case name to "Scan Image On Push"

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-11-07 13:08:32 +08:00
Mia ZHOU
c920b025fa fix the typpo error in nightly test case (#6200) 
Signed-off-by: Meina Zhou <meinaz@vmware.com>
 2018-11-02 09:14:57 +08:00
Meina Zhou
0ba9856c66 fix nightly test 
Signed-off-by: Meina Zhou <meinaz@vmware.com>
 2018-11-01 14:07:55 +08:00
Meina Zhou
b68dd47a20 modify test case since replication log change to popup a new page 
Signed-off-by: Meina Zhou <meinaz@vmware.com>
 2018-10-26 16:20:00 +08:00
Wenkai Yin
f5166431be Update automation test case "Delete Repo" (#6087) 
Replace the "Sleep x seconds" with "Wait Until xxx" in the "Delete Repo" case

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-23 09:08:54 +08:00
Wenkai Yin
96d260a379 Add debug info to automation test case (#6092) 
Add "Capture Page Screenshot" to help debug the case failure

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-23 09:08:33 +08:00
Cheng Fangyuan
8b6e72e56e Vulnerability scan cancel editing to make UI into orginal status 
Signed-off-by: Cheng Fangyuan <fangyuanc@fangyuanc-a01.vmware.com>
 2018-10-19 13:14:43 +08:00
Wenkai Yin
20a6a8738e
Merge pull request #6030 from wy65701436/add-gc-e2e 
add gc e2e test case
 2018-10-16 15:43:35 +08:00
wang yan
3ef52cafd4 Add gc e2e test case 
Signed-off-by: wang yan <wangyan@vmware.com>
 2018-10-16 14:31:57 +08:00
Wenkai Yin
b650bf0d04 Update automation test case "Make Project Public/Private" (#6028) 
Add "Wait Until" to ensure the "Save" button is clicked

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-12 18:29:38 +08:00
Wenkai Yin
32c4392b3b Update test cases (#6011) 
Update the automation test cases to pass the nightly testing

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-11 10:39:25 +08:00
Wenkai Yin
d1981d23b1 Update automation test cases (#5991) 
Longer the wait time to pass the nightly testing

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-10 10:38:48 +08:00
Cheng
9250b1b351 ../../tests/resources/Harbor-Pages/Configuration.robot 
Signed-off-by: Cheng <1309173081@qq.com>
 2018-09-25 13:40:17 +08:00
clouderati
587459df15 Replacing copyright notices with "Copyright Project Harbor Authors". 
Signed-off-by: clouderati <35942204+clouderati@users.noreply.github.com>
 2018-09-19 16:59:36 +00:00
Qian Deng
dfeb1924c6 Fix xpath in robot case 
1. Fix xpath of Upload button
2. Fix xpath of status span

Signed-off-by: Qian Deng <dengq@vmware.com>
 2018-09-10 17:24:28 +08:00
Qian Deng
4d601292d1 Add E2E test for helmchart (#5746) 
Add E2E test for helmchart repo

Signed-off-by: Qian Deng <dengq@vmware.com>
 2018-09-04 15:08:51 +08:00
Wenkai Yin
0561280411 Update robot case to debug the issue got in nightly test (#5576) 
This commit updates the "Sign In Harbor" robot case by adding debug information when it failed
 2018-08-10 13:53:48 +08:00
Mia ZHOU
872b19f370
Merge pull request #5553 from zhoumeina/pr/fix_ui_e2e 
fix nightly test fail for project creation moved to system config
 2018-08-08 11:18:44 +08:00
Mia ZHOU
235a13fa74 fix nightly test fail for project creation moved to system config 
fix nightly test fail for project creation moved to system config
 2018-08-08 10:48:21 +08:00
stonezdj(Daojun Zhang)
ecdfb8034f Add API Test setup and fix Add Member button verify (#5548) 2018-08-08 10:40:35 +08:00
Mia ZHOU
5d76b28a5c Fix e2e test after project creation moved to system config (#5536) 
Fix test project creation for e2e.
 2018-08-07 10:32:23 +08:00
wangyan
b57a9db22a Update member locater according to UI changes 2018-08-02 18:24:05 -07:00
wangyan
5edd408d07 Add scripts to verify Harbor DB migration 2018-07-30 04:54:33 -07:00
Yan
85ded71816 Update e2e cases 
refactor e2e test cases to support new CI pipeline
fix issues caused by recently UI change
 2018-07-19 02:22:03 -07:00
sigsbee
889b36a944
Add data verify robot case after upgrade (#5207) 
Add data verify e2e case after upgrade
 2018-06-29 15:01:26 +08:00
sigsbee
7d6f8f94c4
Change create project verify method (#5184) 
Update create project keyword to avoid created project on the second page caused verify fail
 2018-06-27 11:27:03 +08:00
sigsbee
a6f14c6d89
Update test case to increase passrate (#5083) 
Update test case order to avoid scan on push fail
Add sleep time to avoid view scan results fail
Change keyword to wait unitl avoid delete operation fail
Change delete rule and repicate manual confirm to mouse down and up
 2018-06-05 18:51:11 +08:00
sigsbee
a0bf7196e6 Fix label test case and replicate case (#5075) 
Fix label test case fail for new UI change
Fix replicate manual keyword to avoid case fail
 2018-06-02 01:34:33 +08:00
sigsbee
8d12960494
Fix robot keywords align with UI changes (#5036) 
Fix robot keywords align with UI changes
fix replication case for new delete progress
 2018-05-24 19:53:23 +08:00
sigsbee
8b6963f397
Update testcase for task progress (#4987) 
update multi delete testcase for new delete progress
 2018-05-24 13:07:19 +08:00