Commit Graph

134 Commits

Author SHA1 Message Date
danfengliu
2b16c8b072
Add oidc test cases for 1.8.0 1 (#7971)
* OIDC authentication is a new feature in version 1.8.0, so add nightly GUI test cases for OIDC authentication scenario. (#7745)

Signed-off-by: danfengliu <danfengl@vmware.com>

* Nightly test case user-view-logs failed several times, after debugging, the reason is checking too fast although the operation has not finsished, so I add a checking for end of the operation. (#7858)

Signed-off-by: danfengliu <danfengl@vmware.com>

* Add test case for oidc auth mode (#7860)

* Nightly test case user-view-logs failed several times, after debugging, the reason is checking too fast although the operation has not finsished, so I add a checking for end of the operation.

Signed-off-by: danfengliu <danfengl@vmware.com>

* Add test case Manage-Project-Member for oidc auth mode Jenkins pipeline, this test case reuse the same test case in common file.

Signed-off-by: danfengliu <danfengl@vmware.com>

* Jenkin job cd_daily_master failed due to sign image failure, but there're other failure for replicaiton NG, so API for replication NG need to be updated. (#7778)

Signed-off-by: danfengliu <danfengl@vmware.com>

* Fix bug for manage-project-member, due to keywords changed for oidc-auth-mode, test case  manage-project-member should be debug at the same time. (#7888)

Signed-off-by: danfengliu <danfengl@vmware.com>

* Add test case secret-verify for oidc-auth-mode feature by adding some keywords and one test cases.

Signed-off-by: danfengliu <danfengl@vmware.com>

* Population data tool - prepare.py has been adapted for the latest version due to API changing, but the old version still was needed in other place, so it should be add it back and give it a new name. (#7943)

Signed-off-by: danfengliu <danfengl@vmware.com>

* Add 2 UI test cases which is replication rule edit and delete. (#7904)

Signed-off-by: danfengliu <danfengl@vmware.com>
2019-06-05 10:59:27 +08:00
danfengliu
dffb2bbd98 Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case <Replication Of Pull Images from DockerHub To Self> and <Replication Of Push Images from Self To Harbor> has been finished and ready for duty. Other modification is add retry for keywords in UserProfile.robot (#7611)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-09 15:44:48 +08:00
Steven Zou
b664b90b86
Merge pull request #7585 from steven-zou/add_get_jobs_API
add get jobs API to provide powerful job stats management
2019-05-08 17:17:33 +08:00
Steven Zou
2562146faf adjust the order of robot test case of API_DB
Signed-off-by: Steven Zou <szou@vmware.com>
2019-05-07 16:13:31 +08:00
danfengliu
e08c2e757e This API test script was blocked by a swagger error, now this error was fixed, so robot account script can be finished now. In swagger.yaml, robot account can be updated in "disbled" status, it's added into script. (#7636)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-05-06 11:34:11 +08:00
danfengliu
c4fbcb481e
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here is that test case endpoint add/edit/delete have been finished and ready for duty. (#7496)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-24 11:20:26 +08:00
danfengliu
c3c10a87b2
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case add-replication-test-case-Endpoint-Verification has been finished and ready for duty. (#7472)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-23 15:33:04 +08:00
danfengliu
4e8d4fca85
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipline, and here test case Pro-Replication-Rules-Add has been finished and ready for duty. (#7453)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-22 09:58:02 +08:00
danfengliu
15846ac524
Feature - Replication was upgraded, so the corrsponding UI test cases are nolonger available any more, we left an empty Replication.robot file, then add new test cases step by step. (#7436)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-18 17:07:39 +08:00
wang yan
e017294f71 merge with master latest
Signed-off-by: wang yan <wangyan@vmware.com>
2019-04-17 17:52:39 +08:00
Wenkai Yin
174a1f5bfa Remove the E2E test cases for replication
Remove the E2E test cases for replication

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2019-04-12 17:37:14 +08:00
danfengliu
08b346ee1e
Add API test case for retag, create a user and 2 projects by this new user, push image to 1st project, and retag this image to 2nd project. (#7300)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-04-11 15:05:46 +08:00
FangyuanCheng
82716d492d move vulnerability and gc ui
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
2019-04-03 14:39:46 +08:00
danfengliu
3db3f3a62e
add test cases for jenkins upgrade project, wrap test cases body into new keywords, so that case body appears only in one single place (#7243)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-28 14:37:03 +08:00
danfengliu
6b19b99c97
test case Disable Scan Schedule failed at page should contain part, it missing wait until and retry, so add one (#7228)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-27 15:33:31 +08:00
danfengliu
d9eb519e6c
Test case <List Helm Charts> failed occasionally, due to lacking of wail and retry for action word, so this case need to be refected. (#7165)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-18 18:06:46 +08:00
danfengliu
a618a2c2ac
Button was not clicked successfully in keyword < Delete Repo>, but the click action returned pass, so I add a checkpoint after clicking the delete button, make sure the pop info had disappeared, it means delete button was clicked successfully. (#7071)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-11 10:34:53 +08:00
danfengliu
98c6889053 Configuration item verify_remote_cert is no longer useful, so it was delete from data population script
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-05 15:53:14 +08:00
danfengliu
340577076c
add a jenkins job for migrate harbor from 1.6 to the latest, make some modification in prepare.py to adapt harbor 1.6 (#7025)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-02-27 14:27:39 +08:00
danfengliu
a1063edae6
Add GUI test script for new feature of master-role, without adding a new case for master-role, I add new test steps in old test case named Manage-Project-Members, because master-role is a sub function in project members. (#6945)
In this PR, I also modify a public action keyword to make it suitble for indefinite numbers of parameters.

Signed-off-by: danfengliu <danfengl@vmware.com>
2019-02-22 14:11:56 +08:00
danfengliu
b83cf2e4c0
GC function hbas been change, verify criteria must be changed by add manifests (#6934)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-02-15 11:06:22 +08:00
danfengliu
47530cd62e
remove some sleep and add retry common keyword (#6875)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-31 17:58:05 +08:00
danfengliu
e5efbfe490
add retry keyword for docker pull and push image command. (#6857)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-31 16:08:58 +08:00
danfengliu
9aeb626fe3
The former way to verify project creation is by API calling, but it's not a GUI operation, which is not a goal for operator, so I replace it with GUI verification (#6816)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-28 16:32:45 +08:00
danfengliu
923432a172
resort test case, 2 test cases failed due to unfinish chart data preparation, so resort the test cases, move the verification test case ahead of the 2 failed cases. (#6818)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-25 10:26:14 +08:00
danfengliu
f29960628a Keyword <Go Into Project> has modified, but verify.robot didn't adapt this keyword.
Modifications:
	1.Add paramenter hasimage in data.json
	2.Modify Harbor-Pages\Verify.robot to pass it to <Go Into Project>
	3.Add loop and exception-catch in <Go Into Project> to prevent using Sleep and failure by exception(this exception was caused by short time of paga loading)

Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-17 17:46:17 +08:00
Wenkai Yin
60425676ac
Merge pull request #6733 from danfengliu/Add-WaitUntil-In-Keywords-Stage2
Add wait until in <Multi-delete Object> and <Project Should Display>
2019-01-14 17:22:39 +08:00
danfengliu
73b9e95464 Add wait until in <Multi-delete Object> and <Project Should Display>
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-14 15:19:30 +08:00
danfengliu
de30438d01
modify a code error by copy mistake (#6736)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-14 11:02:11 +08:00
danfengliu
0b27037e34
Two modifications in PR:1. Due to GUI change on position of "project creation" configuration, script must be adjust with the corresponding change; 2. Fixed a issue of no exception caught when http request has error, all the system config will be set by a common request function. (#6715)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-11 13:40:08 +08:00
danfengliu
d853adce46 Robot scripts refactor for keyword sign-in-harbor and other few keywords, mainly on replacing 'sleep' to 'wait until', and also add a checkpoint in "Go Into Project" keyword to verify the result of loading a project page.
Modify Switch To Log and Back To projects
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-08 13:44:14 +08:00
FangyuanCheng
9a52059e89 fix nightly test of retag
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
2018-12-21 17:34:15 +08:00
danfengliu
3356368bff Add API test case assign system admin role. (#6413)
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-12-04 12:26:12 +08:00
danfengliu
b4c7663f5f
Add API test case scan all images and test case API test case list helm charts. (#6388)
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-12-03 17:05:06 +08:00
danfengliu
04fd4d444d
Add API test case for user view logs. (#6370)
Add API test case for user view logs.
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-29 18:27:53 +08:00
danfengliu
c4bf65162c
add api test case for garbage collection (#6366)
Add API test case for garbage collection, and add swagger.yaml, GC and chart feature were updated in swagger.yaml.
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-27 19:17:41 +08:00
danfengliu
ad77098acf
add test case project level policy content trust. (#6309)
Add test case project level policy content trust.
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-21 12:19:28 +08:00
danfengliu
5ceebcbb10
Add tese case of manage project memebers and modify (#6304)
Move admin_client to testutil.py as global parameter.
Change create_repository function name to push_image_to_project to make it reasonable.
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-20 14:24:13 +08:00
Fangyuan Cheng
bbee74eba4
Merge pull request #6298 from pureshine/retag-test
Add E2E test for retag
2018-11-19 12:52:48 +08:00
FangyuanCheng
34dee765ec Add E2E test for retag
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
2018-11-19 12:20:19 +08:00
danfengliu
dcd34a37a9 add test case scan a not scanned image
Modify for codacy issues.
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-16 15:35:15 +08:00
danfengliu
1cc04183cb add test case for edit project creation;
fixed some space and import issues coddcy;
remove a lib;

Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-15 10:32:21 +08:00
danfengliu
7494050534 add test case name in API_DB
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-08 10:33:14 +08:00
danfengliu
a6151175e3 add lib for target
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-08 10:33:14 +08:00
Wenkai Yin
55c609b1a7 Update automation test case (#6221)
1. Add "Wait Until ..." to "Change User Role In Project"
2. Rename case name to "Scan Image On Push"

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-11-07 13:08:32 +08:00
Wenkai Yin
8c376ac55a
Merge pull request #6205 from ywk253100/181102_case
Check the vul data before running scan-on-push case
2018-11-05 21:09:26 +08:00
Wenkai Yin
40f8f4bc5d Check the vul data before running scan-on-push case
Update the automation case to wait until the vul data is ready before running the scan-on-push case

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-11-02 17:54:47 +08:00
danfengliu
1979d17550 add tc add-sys-label-to-tag and del-repo
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-02 17:16:43 +08:00
danfengliu
894e0591bb add new api tests (#6127)
Add API test libraries which were based on swagger doc,
it's including user and project , also add one scenario
test case which is test_add_member_to_private_project to
verify a user can see a project when the uesr is the member of it.
Delete 2 old test case.Delete a quota.

Signed-off-by: danfengliu <danfengl@vmware.com>
2018-10-31 13:13:31 +08:00
wang yan
2ef11c396a Fix failure on GC test case
As the changes on scan all, the default schedule was removed from source code,
hence the gc job should be the first admin job, to change to job id to 1.

Signed-off-by: wang yan <wangyan@vmware.com>
2018-10-29 14:15:06 +08:00