Danfeng Liu (c)
f0750f73de
1. Add element verification for keyword Go Into Project; Make big loop effective by stop assert in keyword Retry Double Keywords When Error; 2. Quota string verification is too restrictive, make it loose a little.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-25 17:44:15 +08:00
Danfeng Liu (c)
08bedb8376
Add a big loop for keyword Go Into Project to make sure if project was not found, search it again
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-22 15:04:22 +08:00
Danfeng Liu (c)
b8a7598ffa
The criteria of keyword Go Into Project is not strong for verify if it's in project repositroy page, so fix this issue by way of 'Retry Double Keywords When Error'.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-22 12:07:20 +08:00
Danfeng Liu (c)
6e1f560544
Modify 2 points, 1st is add wait time right after scan all; 2nd is add name length for project name to avoid naming repeatly.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-21 15:12:21 +08:00
Danfeng Liu (c)
44b9a8d70a
The xpath of repository filter behavior may cause hung-up of repositoy search operation, so change it by the filter in the list column.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-19 14:52:56 +08:00
Danfeng Liu (c)
1a6d9536d6
As the background of clair updated was disabled, and we populate clair db right after harbor deployed with existing data, so all clair relevant test cases should be update as the data of this clair population.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-15 18:08:38 +08:00
Yogi_Wang
e951ceb31c
Modify scan now nightly case
...
Signed-off-by: Yogi_Wang <yawang@vmware.com>
2019-11-13 10:09:03 +08:00
sshijun
14364727ae
Nightly case for tag-retention
...
Signed-off-by: sshijun <sshijun@vmware.com>
2019-11-11 16:58:33 +08:00
Yogi_Wang
58936aae42
Modify nightly case of scanner
...
Signed-off-by: Yogi_Wang <yawang@vmware.com>
2019-11-11 13:19:37 +08:00
danfengliu
e28aae0c90
Merge pull request #9685 from danfengliu/replication-dest-url-changed
...
Modify nightly test case due to replication rule element is modified from selector to input
2019-11-01 15:23:45 +08:00
Danfeng Liu (c)
d8c49d9834
Replication rule element is modified from selector to input, so nightly test case should be updated.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-01 13:08:47 +08:00
sshijun
b4fa143aa4
Modify harbor-shell UI
...
Signed-off-by: sshijun <sshijun@vmware.com>
2019-11-01 09:31:33 +08:00
Danfeng Liu (c)
afdf262ca6
In nightly test case of project members, xpath locator of remove a member is not strong enough for location, it used index of elemment, so it should be update by the meaning of the btn.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-10-28 14:52:24 +08:00
Yogi_Wang
988279cdcb
Add webhook nightly case
...
Signed-off-by: Yogi_Wang <yawang@vmware.com>
2019-10-25 15:25:32 +08:00
Yogi_Wang
7b93e845e1
Modify the words of setting cli secret
...
Signed-off-by: Yogi_Wang <yawang@vmware.com>
2019-10-22 10:11:25 +08:00
Wang Yan
454a427806
Merge pull request #9239 from danfengliu/project-metadata-verification-in-upgrade-verify-script
...
Add project meta data verifcation In nightly migrate pipeline
2019-10-11 14:05:33 +08:00
Danfeng Liu (c)
96a271f388
In nightly migrate pipeline, after migration, should check all the data which were populated, for now, project meta data were populated, but were not been verified, so I add these verification in this PR.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-10-11 10:28:02 +08:00
Danfeng Liu (c)
20dc245631
In nightly helm pipeline, test case 'Project Quotas Control Under GC' failed, it should be timing issue that the valuse in UI is not ready, so I add a keyword 'Retry Keyword When Return Value Mismatch' to retry value getting action.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-25 17:02:05 +08:00
danfengliu
1157f129b4
After angular upgrade, in DB.robot, 4 test cases failed at create-a-new-user, the reason is that no sleep between input or click action, some blank was not inputed, so I add retry keyword for those actions.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-24 10:55:38 +08:00
danfengliu
7844ca0a2f
Merge pull request #9214 from danfengliu/add-nightly-test-case-of-retag-under-readonly-mode
...
Add id for system configuration repo-readonly-checkbox in UI code
2019-09-24 10:43:55 +08:00
Danfeng Liu (c)
3c8db37616
Add id for system configuration repo-readonly-checkbox in UI code, and add element locator in robot case.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-23 21:55:27 +08:00
danfengliu
cb5a145f27
Merge pull request #9212 from danfengliu/upgrade-preparev17-for-new-migrate-jenkins-pipeline-add-more-test-data
...
commented 2 lines to remove Vulnerability scan all data verification
2019-09-23 19:00:19 +08:00
Danfeng Liu (c)
6e4331fb92
In this PR right now, I commented 2 lines to remove a verification, it's because that Vulnerability data is not consistent when migrate harbor from 1.7 to 1.9, I've filed an issue to follow it, once it's fixed, these 2 commented lines will be come back.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-23 16:14:01 +08:00
Danfeng Liu (c)
cca1fab069
Modify sign-up button xpath from relative html path to id, and modify script.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-23 15:40:27 +08:00
Danfeng Liu (c)
9a147f0999
In nightly test, keyword <Create An New Project> failed after angular upgrade, the OK button in create new project page was clicked, but it's not effective, so I add a retry for OK button click, if the button was not disappeared, script will be clicked again.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-20 16:22:10 +08:00
Danfeng Liu (c)
9e05e6dc74
After angula upraded, all migrate pipelines failed at system setting project creation verification. Keyword of Page Should Contain is not working anymore in new UI, so I choosen a new more precise way of checking the select element value of 'everyone'
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-20 14:55:53 +08:00
Danfeng Liu (c)
5d1913842c
Script test case for project quotas, there will be 2 or 3 test cases in this PR, like project quota edit, prject quota functionality.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-18 17:55:25 +08:00
Yogi_Wang
a7c7a8e675
Upgrade angualr from 7.1.3 to 8.2.0 and clarity from 1.0 to 2.2
...
Signed-off-by: Yogi_Wang <yawang@vmware.com>
Signed-off-by: Meina Zhou <meinaz@vmware.com>
Signed-off-by: sshijun <sshijun@vmware.com>
2019-09-18 10:12:20 +08:00
Danfeng Liu (c)
ca8590c878
Replace CVE sample image from other to redis in union, redis is stable in relative, so test result will be stable relatively
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-09 18:36:07 +08:00
danfengliu
8503957eac
1.Add CVE white list API test into API_DB.robot;2.Random data for prject name should use lower case %m%s;3.Replace from harbor to self.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-04 15:50:09 +08:00
danfengliu
7d681c623b
Add AWS-ECR and Google-GCR replication test into nighly tests.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-02 17:53:49 +08:00
danfengliu
7217ed5358
Add CVE Whitelist test cases into nightly test, first test case is system CVE Whitelist test.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-28 14:01:43 +08:00
danfengliu
6818ce9b06
Adding retry for wait element visibility, in nightly test case Developer-Operate-Labels, project didn't show up when checking its visiblity, so add some wait for this check. ( #8554 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-05 16:13:39 +08:00
danfengliu
b7803571d4
Currently, nightly test pipeline was only in one level category of auth_mode and upgrade, now we like to add a level base on the original level which is harbor deployment parameters. ( #8398 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-01 15:10:54 +08:00
danfengliu
a31d12e01e
modify xpath of project member due to summary tab was added in project. ( #8421 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-07-26 17:18:47 +08:00
danfengliu
554b0771fe
Due to adding new feature for white list, xpath of configuration changed, it caused failure of nightly tests, so it should be fixed. ( #8307 )
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-07-17 16:46:26 +08:00
danfengliu
9b61bf4fce
In nightly test case 'list helm chart', delete chart ( #8280 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-07-17 15:32:10 +08:00
danfengliu
a8300d91e6
Add a nightly test case helm CLI, in this case, we verify help repo add and helm push. ( #8240 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-07-16 14:00:30 +08:00
danfengliu
db012c816d
In nightly test case <Delete Multi Member>, 'action' was clicked, but the dropdown list was't not shown up, so we should add a comfirmation to make sure the expected element show up. ( #8146 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-07-08 15:28:28 +08:00
danfengliu
432d0757f0
In nightly test, case Disable-Scan-Schedule always failed at action of edit button click, so we should add a comfirmation to make sure that this button will be disappeared after click action. ( #8126 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-06-24 18:09:34 +08:00
danfengliu
a9998adfae
In robot-framework, Element Clicked returns OK, but the element was not click functionally
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-06-17 16:12:38 +08:00
danfengliu
d8b76c482a
Add 2 UI test cases which is replication rule edit and delete. ( #7904 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-06-03 16:58:24 +08:00
danfengliu
e66d857fbc
Add test case secret-verify for oidc-auth-mode feature by adding some keywords and one test cases.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-27 14:31:14 +08:00
danfengliu
a2b651969c
Fix bug for manage-project-member, due to keywords changed for oidc-auth-mode, test case manage-project-member should be debug at the same time. ( #7888 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-24 15:22:28 +08:00
danfengliu
fed310a974
Add test case for oidc auth mode ( #7860 )
...
* Nightly test case user-view-logs failed several times, after debugging, the reason is checking too fast although the operation has not finsished, so I add a checking for end of the operation.
Signed-off-by: danfengliu <danfengl@vmware.com>
* Add test case Manage-Project-Member for oidc auth mode Jenkins pipeline, this test case reuse the same test case in common file.
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-23 15:43:59 +08:00
danfengliu
7b7f7a920a
Nightly test case user-view-logs failed several times, after debugging, the reason is checking too fast although the operation has not finsished, so I add a checking for end of the operation. ( #7858 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-22 14:06:07 +08:00
danfengliu
a503944110
OIDC authentication is a new feature in version 1.8.0, so add nightly GUI test cases for OIDC authentication scenario. ( #7745 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-22 11:19:08 +08:00
danfengliu
8a2ee784a4
Missing modification in keyword <Create A New Endpoint>, due to changing of docker-hub select item, it must be modified. ( #7754 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-10 14:24:12 +08:00
danfengliu
dffb2bbd98
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case <Replication Of Pull Images from DockerHub To Self> and <Replication Of Push Images from Self To Harbor> has been finished and ready for duty. Other modification is add retry for keywords in UserProfile.robot ( #7611 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-09 15:44:48 +08:00
danfengliu
c4fbcb481e
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here is that test case endpoint add/edit/delete have been finished and ready for duty. ( #7496 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-24 11:20:26 +08:00