danfengliu
ac0d3c991a
Add nightly test case of 'Retag should be forbidden when system configuration read-only mode was set'.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-10-10 17:13:19 +08:00
danfengliu
feeb6fb2d8
1. Nightly test case failed due to more vulnerbility CVE IDs in image redis, so add 2 new CVE IDs in CVE Whitelist test cases. 2. A Keyword parameter error was fixed in this PR.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-10-02 16:43:50 +08:00
danfengliu
f6759a0353
Merge pull request #9289 from danfengliu/add-cve-for-redis
...
Add a new CVE ID for image redis in nightly CVE system and project level whitelist tests
2019-09-27 22:05:25 +08:00
danfengliu
2298b96170
In nightly CVE whitelist tests, there be a new CVE occured in image redis, so add this for test verifcation.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-27 17:20:06 +08:00
Danfeng Liu (c)
20dc245631
In nightly helm pipeline, test case 'Project Quotas Control Under GC' failed, it should be timing issue that the valuse in UI is not ready, so I add a keyword 'Retry Keyword When Return Value Mismatch' to retry value getting action.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-25 17:02:05 +08:00
Danfeng Liu (c)
5d1913842c
Script test case for project quotas, there will be 2 or 3 test cases in this PR, like project quota edit, prject quota functionality.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-18 17:55:25 +08:00
Wang Yan
6b5fd36bb3
add e2e test case for project quota
...
1. Create a new user(UA);
2. Create a new private project(PA) by user(UA);
3. Add user(UA) as a member of project(PA) with project-admin role;
4. Push an image to project(PA) by user(UA), then check the project quota usage;
5. Check quota change
6. Delete image, the quota should be changed to 0.
Signed-off-by: wang yan <wangyan@vmware.com>
2019-09-15 22:16:11 +08:00
Danfeng Liu (c)
ca8590c878
Replace CVE sample image from other to redis in union, redis is stable in relative, so test result will be stable relatively
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-09 18:36:07 +08:00
jwangyangls
f200125abb
Merge pull request #8980 from danfengliu/replace-image-for-ECR-test
...
Replace image from tomcat to alpine for small size
2019-09-06 21:02:45 +08:00
Ziming Zhang
722e45b20b
add swagger for tag retention
...
Signed-off-by: Ziming Zhang <zziming@vmware.com>
Change-Id: I0f3ed8085e231868de74c273ba85946826181d5b
2019-09-06 17:27:20 +08:00
Danfeng Liu (c)
13af86dd85
Replace image from tomcat to alpine for small size, then it will not take a long time for replication.
...
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
2019-09-06 17:26:47 +08:00
danfengliu
8539ce7b77
Add CVE whitelist project level API test into travis tests.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-05 18:02:53 +08:00
danfengliu
8503957eac
1.Add CVE white list API test into API_DB.robot;2.Random data for prject name should use lower case %m%s;3.Replace from harbor to self.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-04 15:50:09 +08:00
danfengliu
5c8890bc6d
Replace image from httpd to haproxy:1.5 to make sure serverity is stable for test.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-03 14:04:59 +08:00
Wang Yan
4d5e549731
Merge pull request #8904 from danfengliu/Add-ECR-And-GCR-registry-to-nightly-replication-tests
...
Add AWS-ECR and Google-GCR replication test into nighly tests.
2019-09-03 13:38:57 +08:00
danfengliu
7d681c623b
Add AWS-ECR and Google-GCR replication test into nighly tests.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-09-02 17:53:49 +08:00
danfengliu
68fd128252
Clair scan result is not accurate that when I script this case, only 6 high CVE-ID, but in today nightly result, one more CVE-ID popuped, so I have to add it.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-30 09:55:55 +08:00
danfengliu
7217ed5358
Add CVE Whitelist test cases into nightly test, first test case is system CVE Whitelist test.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-28 14:01:43 +08:00
danfengliu
2aa6f1aed7
Merge branch 'master' into add-sign-api-back-to-travis-despite-codacy-1
2019-08-16 16:28:49 +08:00
wang yan
ddb913f8d0
Add API test case sign image back to travis, despite codacy block it when pulling a pr.
...
Signed-off-by: wang yan <wangyan@vmware.com>
2019-08-16 01:26:36 -07:00
danfengliu
1f53a47102
add replication testcase in api_db.robot file ( #8636 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-14 10:45:20 +08:00
danfengliu
b7803571d4
Currently, nightly test pipeline was only in one level category of auth_mode and upgrade, now we like to add a level base on the original level which is harbor deployment parameters. ( #8398 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-08-01 15:10:54 +08:00
danfengliu
8665274406
In nighly test case <Project Level Image Serverity Policy>, scan result of haproxy image is nolonger high but medium, it should be a bug of clair, so we replace haproxy by postgres, and also we pull postgres with sha256 to make sure the image under test is alway the specific one.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-07-25 10:27:10 +08:00
danfengliu
9b61bf4fce
In nightly test case 'list helm chart', delete chart ( #8280 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-07-17 15:32:10 +08:00
danfengliu
a8300d91e6
Add a nightly test case helm CLI, in this case, we verify help repo add and helm push. ( #8240 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-07-16 14:00:30 +08:00
danfengliu
d8b76c482a
Add 2 UI test cases which is replication rule edit and delete. ( #7904 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-06-03 16:58:24 +08:00
danfengliu
9d78038940
Population data tool - prepare.py has been adapted for the latest version due to API changing, but the old version still was needed in other place, so it should be add it back and give it a new name. ( #7943 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-31 17:05:27 +08:00
danfengliu
496533296d
Jenkin job cd_daily_master failed due to sign image failure, but there're other failure for replicaiton NG, so API for replication NG need to be updated. ( #7778 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-30 15:59:09 +08:00
danfengliu
e66d857fbc
Add test case secret-verify for oidc-auth-mode feature by adding some keywords and one test cases.
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-27 14:31:14 +08:00
danfengliu
a2b651969c
Fix bug for manage-project-member, due to keywords changed for oidc-auth-mode, test case manage-project-member should be debug at the same time. ( #7888 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-24 15:22:28 +08:00
danfengliu
fed310a974
Add test case for oidc auth mode ( #7860 )
...
* Nightly test case user-view-logs failed several times, after debugging, the reason is checking too fast although the operation has not finsished, so I add a checking for end of the operation.
Signed-off-by: danfengliu <danfengl@vmware.com>
* Add test case Manage-Project-Member for oidc auth mode Jenkins pipeline, this test case reuse the same test case in common file.
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-23 15:43:59 +08:00
danfengliu
a503944110
OIDC authentication is a new feature in version 1.8.0, so add nightly GUI test cases for OIDC authentication scenario. ( #7745 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-22 11:19:08 +08:00
danfengliu
dffb2bbd98
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case <Replication Of Pull Images from DockerHub To Self> and <Replication Of Push Images from Self To Harbor> has been finished and ready for duty. Other modification is add retry for keywords in UserProfile.robot ( #7611 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-09 15:44:48 +08:00
Steven Zou
b664b90b86
Merge pull request #7585 from steven-zou/add_get_jobs_API
...
add get jobs API to provide powerful job stats management
2019-05-08 17:17:33 +08:00
Steven Zou
2562146faf
adjust the order of robot test case of API_DB
...
Signed-off-by: Steven Zou <szou@vmware.com>
2019-05-07 16:13:31 +08:00
danfengliu
e08c2e757e
This API test script was blocked by a swagger error, now this error was fixed, so robot account script can be finished now. In swagger.yaml, robot account can be updated in "disbled" status, it's added into script. ( #7636 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-06 11:34:11 +08:00
danfengliu
c4fbcb481e
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here is that test case endpoint add/edit/delete have been finished and ready for duty. ( #7496 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-24 11:20:26 +08:00
danfengliu
c3c10a87b2
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case add-replication-test-case-Endpoint-Verification has been finished and ready for duty. ( #7472 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-23 15:33:04 +08:00
danfengliu
4e8d4fca85
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipline, and here test case Pro-Replication-Rules-Add has been finished and ready for duty. ( #7453 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-22 09:58:02 +08:00
danfengliu
15846ac524
Feature - Replication was upgraded, so the corrsponding UI test cases are nolonger available any more, we left an empty Replication.robot file, then add new test cases step by step. ( #7436 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-18 17:07:39 +08:00
wang yan
e017294f71
merge with master latest
...
Signed-off-by: wang yan <wangyan@vmware.com>
2019-04-17 17:52:39 +08:00
Wenkai Yin
174a1f5bfa
Remove the E2E test cases for replication
...
Remove the E2E test cases for replication
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2019-04-12 17:37:14 +08:00
danfengliu
08b346ee1e
Add API test case for retag, create a user and 2 projects by this new user, push image to 1st project, and retag this image to 2nd project. ( #7300 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-11 15:05:46 +08:00
FangyuanCheng
82716d492d
move vulnerability and gc ui
...
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
2019-04-03 14:39:46 +08:00
danfengliu
3db3f3a62e
add test cases for jenkins upgrade project, wrap test cases body into new keywords, so that case body appears only in one single place ( #7243 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-28 14:37:03 +08:00
danfengliu
6b19b99c97
test case Disable Scan Schedule failed at page should contain part, it missing wait until and retry, so add one ( #7228 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-27 15:33:31 +08:00
danfengliu
d9eb519e6c
Test case <List Helm Charts> failed occasionally, due to lacking of wail and retry for action word, so this case need to be refected. ( #7165 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-18 18:06:46 +08:00
danfengliu
a618a2c2ac
Button was not clicked successfully in keyword < Delete Repo>, but the click action returned pass, so I add a checkpoint after clicking the delete button, make sure the pop info had disappeared, it means delete button was clicked successfully. ( #7071 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-11 10:34:53 +08:00
danfengliu
98c6889053
Configuration item verify_remote_cert is no longer useful, so it was delete from data population script
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-05 15:53:14 +08:00
danfengliu
340577076c
add a jenkins job for migrate harbor from 1.6 to the latest, make some modification in prepare.py to adapt harbor 1.6 ( #7025 )
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-02-27 14:27:39 +08:00