danfengliu
79f93af471
Merge pull request #10333 from danfengliu/add-time-waiting-for-tag-switch
...
Replace keyword without waiting to one which had waiting
2019-12-30 14:45:24 +08:00
danfengliu
de2ec7d063
Replace keyword without waiting to one which had waiting
...
1. Replace all keywords without using waiting;
2. Add a debug line in Go Into Repo for UI hung trouble shooting.
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-12-27 17:13:25 +08:00
danfengliu
933dc91ba5
Notary test failed in Helm Pipeline
...
In Helm pipeline, harbor access address is by domain name instead of IP, so cert directory should be created by domain name.
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-12-27 17:02:28 +08:00
Danfeng Liu (c)
8bfc5d12c3
Change parameter image to optional
...
1. Change parameter in Keyword Body Of Admin Push Signed Image to an
optional one.
2. Loose the restriction for Quotas error message verification.
3. Get cert for notary from API instead of local file.
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-12-19 16:54:59 +08:00
Danfeng Liu (c)
9961d8b0d6
O
...
Add notary remove signature test case in nightly
1. Update E2E image Dockerfile for adding notary CLI;
2. Add test case of remove notary signature.
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-12-17 21:00:08 -08:00
danfengliu
6d80803dbb
Merge pull request #10091 from danfengliu/update-e2e-dockerfile-to-latest
...
Maintain E2E image Dockerfile
2019-12-12 14:04:53 +08:00
Danfeng Liu (c)
fb80ef9cb9
Update E2E image Dockerfile
...
1. update and docker-compose;
2. Install helm and helm3.
3. dockerd-entrypoint.sh has been modify by commit image manually, so it should be updated.
4. Keyword <Get Matching Xpath Count> is no longer recommended in
library Selenium2Library. After Dockerfile is updated and image is going
to be rebuiled, library Selenium2Library has be updated to 3.0.0, but
not 1.8.0, so keyword must be upgraded.
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-12-12 10:31:15 +08:00
Danfeng Liu (c)
7dbe84d9c6
1. Add nightly test case of Robot-Account; 2. In Go Into Repo keyword, filter element should not be clicked since list in loading state, so add some sleep and waiting for the cirlce icon is gone; 3. Move read-only test case in the end of common.robot.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-12-03 14:46:54 +08:00
Danfeng Liu (c)
156b1b0687
As we like to use a local registry for nightly quotas test, so that the sample image will not be update without noticed, so modify quotas test case to use local image for pulling.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-29 14:56:41 +08:00
Danfeng Liu (c)
1698cc034a
Add a replication scope keyword for waiting the completion fo replication result. All replication test case must use this keyword to verify if image was pulled.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-27 15:51:03 +08:00
Danfeng Liu (c)
b7bd34d181
It's a temporary solution for quotas case, after internal registry in service, image size will not change any longer.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-26 15:27:50 +08:00
Danfeng Liu (c)
f0750f73de
1. Add element verification for keyword Go Into Project; Make big loop effective by stop assert in keyword Retry Double Keywords When Error; 2. Quota string verification is too restrictive, make it loose a little.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-25 17:44:15 +08:00
Danfeng Liu (c)
6e1f560544
Modify 2 points, 1st is add wait time right after scan all; 2nd is add name length for project name to avoid naming repeatly.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-21 15:12:21 +08:00
Danfeng Liu (c)
1a6d9536d6
As the background of clair updated was disabled, and we populate clair db right after harbor deployed with existing data, so all clair relevant test cases should be update as the data of this clair population.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-11-15 18:08:38 +08:00
Yogi_Wang
e951ceb31c
Modify scan now nightly case
...
Signed-off-by: Yogi_Wang <yawang@vmware.com>
2019-11-13 10:09:03 +08:00
sshijun
14364727ae
Nightly case for tag-retention
...
Signed-off-by: sshijun <sshijun@vmware.com>
2019-11-11 16:58:33 +08:00
Yogi_Wang
58936aae42
Modify nightly case of scanner
...
Signed-off-by: Yogi_Wang <yawang@vmware.com>
2019-11-11 13:19:37 +08:00
Danfeng Liu (c)
76c5cb85ec
Before user keyword Enable Self Reg, explore should be opened and navigate to harbor log in page.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-10-28 17:24:07 +08:00
Yogi_Wang
988279cdcb
Add webhook nightly case
...
Signed-off-by: Yogi_Wang <yawang@vmware.com>
2019-10-25 15:25:32 +08:00
Danfeng Liu (c)
7a7ac09fa0
Currently, self registration was disabled after harbor deployment, so all nightly db.robot test cases failed. To correct this, we should enable self-registration before running db test cases.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-10-21 14:34:34 +08:00
Danfeng Liu (c)
732eda4196
Project quotas counting result is growing a little bit for unknow reason, images redis size was caculating from 25.8 to 25.9, so error message should be updated.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-10-18 10:30:05 +08:00
danfengliu
ac0d3c991a
Add nightly test case of 'Retag should be forbidden when system configuration read-only mode was set'.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-10-10 17:13:19 +08:00
danfengliu
feeb6fb2d8
1. Nightly test case failed due to more vulnerbility CVE IDs in image redis, so add 2 new CVE IDs in CVE Whitelist test cases. 2. A Keyword parameter error was fixed in this PR.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-10-02 16:43:50 +08:00
danfengliu
f6759a0353
Merge pull request #9289 from danfengliu/add-cve-for-redis
...
Add a new CVE ID for image redis in nightly CVE system and project level whitelist tests
2019-09-27 22:05:25 +08:00
danfengliu
2298b96170
In nightly CVE whitelist tests, there be a new CVE occured in image redis, so add this for test verifcation.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-27 17:20:06 +08:00
Danfeng Liu (c)
20dc245631
In nightly helm pipeline, test case 'Project Quotas Control Under GC' failed, it should be timing issue that the valuse in UI is not ready, so I add a keyword 'Retry Keyword When Return Value Mismatch' to retry value getting action.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-25 17:02:05 +08:00
Danfeng Liu (c)
5d1913842c
Script test case for project quotas, there will be 2 or 3 test cases in this PR, like project quota edit, prject quota functionality.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-18 17:55:25 +08:00
Danfeng Liu (c)
ca8590c878
Replace CVE sample image from other to redis in union, redis is stable in relative, so test result will be stable relatively
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-09 18:36:07 +08:00
Danfeng Liu (c)
13af86dd85
Replace image from tomcat to alpine for small size, then it will not take a long time for replication.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-06 17:26:47 +08:00
danfengliu
8503957eac
1.Add CVE white list API test into API_DB.robot;2.Random data for prject name should use lower case %m%s;3.Replace from harbor to self.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-04 15:50:09 +08:00
danfengliu
5c8890bc6d
Replace image from httpd to haproxy:1.5 to make sure serverity is stable for test.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-03 14:04:59 +08:00
Wang Yan
4d5e549731
Merge pull request #8904 from danfengliu/Add-ECR-And-GCR-registry-to-nightly-replication-tests
...
Add AWS-ECR and Google-GCR replication test into nighly tests.
2019-09-03 13:38:57 +08:00
danfengliu
7d681c623b
Add AWS-ECR and Google-GCR replication test into nighly tests.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-02 17:53:49 +08:00
danfengliu
68fd128252
Clair scan result is not accurate that when I script this case, only 6 high CVE-ID, but in today nightly result, one more CVE-ID popuped, so I have to add it.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-30 09:55:55 +08:00
danfengliu
7217ed5358
Add CVE Whitelist test cases into nightly test, first test case is system CVE Whitelist test.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-28 14:01:43 +08:00
danfengliu
b7803571d4
Currently, nightly test pipeline was only in one level category of auth_mode and upgrade, now we like to add a level base on the original level which is harbor deployment parameters. ( #8398 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-01 15:10:54 +08:00
danfengliu
8665274406
In nighly test case <Project Level Image Serverity Policy>, scan result of haproxy image is nolonger high but medium, it should be a bug of clair, so we replace haproxy by postgres, and also we pull postgres with sha256 to make sure the image under test is alway the specific one.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-07-25 10:27:10 +08:00
danfengliu
9b61bf4fce
In nightly test case 'list helm chart', delete chart ( #8280 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-07-17 15:32:10 +08:00
danfengliu
a8300d91e6
Add a nightly test case helm CLI, in this case, we verify help repo add and helm push. ( #8240 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-07-16 14:00:30 +08:00
danfengliu
d8b76c482a
Add 2 UI test cases which is replication rule edit and delete. ( #7904 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-06-03 16:58:24 +08:00
danfengliu
e66d857fbc
Add test case secret-verify for oidc-auth-mode feature by adding some keywords and one test cases.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-27 14:31:14 +08:00
danfengliu
a2b651969c
Fix bug for manage-project-member, due to keywords changed for oidc-auth-mode, test case manage-project-member should be debug at the same time. ( #7888 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-24 15:22:28 +08:00
danfengliu
fed310a974
Add test case for oidc auth mode ( #7860 )
...
* Nightly test case user-view-logs failed several times, after debugging, the reason is checking too fast although the operation has not finsished, so I add a checking for end of the operation.
Signed-off-by: danfengliu <danfengl@vmware.com>
* Add test case Manage-Project-Member for oidc auth mode Jenkins pipeline, this test case reuse the same test case in common file.
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-23 15:43:59 +08:00
danfengliu
a503944110
OIDC authentication is a new feature in version 1.8.0, so add nightly GUI test cases for OIDC authentication scenario. ( #7745 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-22 11:19:08 +08:00
danfengliu
dffb2bbd98
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case <Replication Of Pull Images from DockerHub To Self> and <Replication Of Push Images from Self To Harbor> has been finished and ready for duty. Other modification is add retry for keywords in UserProfile.robot ( #7611 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-09 15:44:48 +08:00
danfengliu
c4fbcb481e
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here is that test case endpoint add/edit/delete have been finished and ready for duty. ( #7496 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-24 11:20:26 +08:00
danfengliu
c3c10a87b2
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case add-replication-test-case-Endpoint-Verification has been finished and ready for duty. ( #7472 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-23 15:33:04 +08:00
danfengliu
4e8d4fca85
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipline, and here test case Pro-Replication-Rules-Add has been finished and ready for duty. ( #7453 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-22 09:58:02 +08:00
danfengliu
15846ac524
Feature - Replication was upgraded, so the corrsponding UI test cases are nolonger available any more, we left an empty Replication.robot file, then add new test cases step by step. ( #7436 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-18 17:07:39 +08:00
FangyuanCheng
82716d492d
move vulnerability and gc ui
...
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
2019-04-03 14:39:46 +08:00