Upstream/harbor
1
0
Fork 0
mirror of https://github.com/goharbor/harbor.git synced 2024-12-25 10:07:43 +01:00
Code Issues Projects Releases Wiki Activity
8,105 Commits 55 Branches 321 Tags 340 MiB
60dfb87caa
Commit Graph

48 Commits

Author SHA1 Message Date
Danfeng Liu (c)
156b1b0687 As we like to use a local registry for nightly quotas test, so that the sample image will not be update without noticed, so modify quotas test case to use local image for pulling. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-11-29 14:56:41 +08:00
Danfeng Liu (c)
b7bd34d181 It's a temporary solution for quotas case, after internal registry in service, image size will not change any longer. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-11-26 15:27:50 +08:00
Danfeng Liu (c)
f0750f73de 1. Add element verification for keyword Go Into Project; Make big loop effective by stop assert in keyword Retry Double Keywords When Error; 2. Quota string verification is too restrictive, make it loose a little. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-11-25 17:44:15 +08:00
Danfeng Liu (c)
6e1f560544 Modify 2 points, 1st is add wait time right after scan all; 2nd is add name length for project name to avoid naming repeatly. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-11-21 15:12:21 +08:00
sshijun
14364727ae Nightly case for tag-retention 
Signed-off-by: sshijun <sshijun@vmware.com>
 2019-11-11 16:58:33 +08:00
Yogi_Wang
58936aae42 Modify nightly case of scanner 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-11-11 13:19:37 +08:00
Danfeng Liu (c)
76c5cb85ec Before user keyword Enable Self Reg, explore should be opened and navigate to harbor log in page. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-10-28 17:24:07 +08:00
Yogi_Wang
988279cdcb Add webhook nightly case 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-10-25 15:25:32 +08:00
Danfeng Liu (c)
732eda4196 Project quotas counting result is growing a little bit for unknow reason, images redis size was caculating from 25.8 to 25.9, so error message should be updated. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-10-18 10:30:05 +08:00
danfengliu
ac0d3c991a Add nightly test case of 'Retag should be forbidden when system configuration read-only mode was set'. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-10-10 17:13:19 +08:00
danfengliu
feeb6fb2d8 1. Nightly test case failed due to more vulnerbility CVE IDs in image redis, so add 2 new CVE IDs in CVE Whitelist test cases. 2. A Keyword parameter error was fixed in this PR. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-10-02 16:43:50 +08:00
Danfeng Liu (c)
20dc245631 In nightly helm pipeline, test case 'Project Quotas Control Under GC' failed, it should be timing issue that the valuse in UI is not ready, so I add a keyword 'Retry Keyword When Return Value Mismatch' to retry value getting action. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-09-25 17:02:05 +08:00
Danfeng Liu (c)
5d1913842c Script test case for project quotas, there will be 2 or 3 test cases in this PR, like project quota edit, prject quota functionality. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-09-18 17:55:25 +08:00
danfengliu
b7803571d4
Currently, nightly test pipeline was only in one level category of auth_mode and upgrade, now we like to add a level base on the original level which is harbor deployment parameters. (#8398) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-08-01 15:10:54 +08:00
danfengliu
8665274406 In nighly test case <Project Level Image Serverity Policy>, scan result of haproxy image is nolonger high but medium, it should be a bug of clair, so we replace haproxy by postgres, and also we pull postgres with sha256 to make sure the image under test is alway the specific one. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-07-25 10:27:10 +08:00
danfengliu
9b61bf4fce
In nightly test case 'list helm chart', delete chart (#8280) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-07-17 15:32:10 +08:00
danfengliu
a8300d91e6
Add a nightly test case helm CLI, in this case, we verify help repo add and helm push. (#8240) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-07-16 14:00:30 +08:00
danfengliu
a2b651969c
Fix bug for manage-project-member, due to keywords changed for oidc-auth-mode, test case manage-project-member should be debug at the same time. (#7888) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-24 15:22:28 +08:00
danfengliu
fed310a974
Add test case for oidc auth mode (#7860) 
* Nightly test case user-view-logs failed several times, after debugging, the reason is checking too fast although the operation has not finsished, so I add a checking for end of the operation.

Signed-off-by: danfengliu <danfengl@vmware.com>

* Add test case Manage-Project-Member for oidc auth mode Jenkins pipeline, this test case reuse the same test case in common file.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-23 15:43:59 +08:00
danfengliu
a503944110
OIDC authentication is a new feature in version 1.8.0, so add nightly GUI test cases for OIDC authentication scenario. (#7745) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-22 11:19:08 +08:00
FangyuanCheng
82716d492d move vulnerability and gc ui 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-03 14:39:46 +08:00
danfengliu
3db3f3a62e
add test cases for jenkins upgrade project, wrap test cases body into new keywords, so that case body appears only in one single place (#7243) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-28 14:37:03 +08:00
danfengliu
6b19b99c97
test case Disable Scan Schedule failed at page should contain part, it missing wait until and retry, so add one (#7228) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-27 15:33:31 +08:00
danfengliu
d9eb519e6c
Test case <List Helm Charts> failed occasionally, due to lacking of wail and retry for action word, so this case need to be refected. (#7165) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-18 18:06:46 +08:00
danfengliu
a618a2c2ac
Button was not clicked successfully in keyword < Delete Repo>, but the click action returned pass, so I add a checkpoint after clicking the delete button, make sure the pop info had disappeared, it means delete button was clicked successfully. (#7071) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-11 10:34:53 +08:00
danfengliu
a1063edae6
Add GUI test script for new feature of master-role, without adding a new case for master-role, I add new test steps in old test case named Manage-Project-Members, because master-role is a sub function in project members. (#6945) 
In this PR, I also modify a public action keyword to make it suitble for indefinite numbers of parameters.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-02-22 14:11:56 +08:00
danfengliu
b83cf2e4c0
GC function hbas been change, verify criteria must be changed by add manifests (#6934) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-02-15 11:06:22 +08:00
danfengliu
47530cd62e
remove some sleep and add retry common keyword (#6875) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-31 17:58:05 +08:00
danfengliu
e5efbfe490
add retry keyword for docker pull and push image command. (#6857) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-31 16:08:58 +08:00
danfengliu
9aeb626fe3
The former way to verify project creation is by API calling, but it's not a GUI operation, which is not a goal for operator, so I replace it with GUI verification (#6816) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-28 16:32:45 +08:00
danfengliu
923432a172
resort test case, 2 test cases failed due to unfinish chart data preparation, so resort the test cases, move the verification test case ahead of the 2 failed cases. (#6818) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-25 10:26:14 +08:00
danfengliu
73b9e95464 Add wait until in <Multi-delete Object> and <Project Should Display> 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-14 15:19:30 +08:00
danfengliu
d853adce46 Robot scripts refactor for keyword sign-in-harbor and other few keywords, mainly on replacing 'sleep' to 'wait until', and also add a checkpoint in "Go Into Project" keyword to verify the result of loading a project page. 
Modify Switch To Log and Back To projects
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-08 13:44:14 +08:00
FangyuanCheng
9a52059e89 fix nightly test of retag 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2018-12-21 17:34:15 +08:00
FangyuanCheng
34dee765ec Add E2E test for retag 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2018-11-19 12:20:19 +08:00
Wenkai Yin
55c609b1a7 Update automation test case (#6221) 
1. Add "Wait Until ..." to "Change User Role In Project"
2. Rename case name to "Scan Image On Push"

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-11-07 13:08:32 +08:00
Wenkai Yin
40f8f4bc5d Check the vul data before running scan-on-push case 
Update the automation case to wait until the vul data is ready before running the scan-on-push case

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-11-02 17:54:47 +08:00
wang yan
2ef11c396a Fix failure on GC test case 
As the changes on scan all, the default schedule was removed from source code,
hence the gc job should be the first admin job, to change to job id to 1.

Signed-off-by: wang yan <wangyan@vmware.com>
 2018-10-29 14:15:06 +08:00
Wenkai Yin
6c033574fa Update automation test case "Delete Multi Project" (#6116) 
Add "Wait Until xxx" to wait the expected page appear before the next step to avoid the case failure

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-24 15:37:36 +08:00
Wenkai Yin
20a6a8738e
Merge pull request #6030 from wy65701436/add-gc-e2e 
add gc e2e test case
 2018-10-16 15:43:35 +08:00
wang yan
3ef52cafd4 Add gc e2e test case 
Signed-off-by: wang yan <wangyan@vmware.com>
 2018-10-16 14:31:57 +08:00
Wenkai Yin
16c9ffad2c Update automation test case "Project Level Image Serverity Policy" (#6037) 
Currently, the case "Project Level Image Serverity Policy" uses the project library as the target project, but the project library has been set to scan image automatically when images are pushing, this will cause case failure. This commit creates a new project in the case to aviod the failure.

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-16 09:01:23 +08:00
Wenkai Yin
7e3ae5cb11 Update scan automation test case 
Replace image hello-world with busybox as the hello-world has been scaned in the last case

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-12 11:22:43 +08:00
Wenkai Yin
00acb507ba Update automation test cases 
Update the case to pass nightly testing for Harbor chart

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-11 15:29:43 +08:00
Wenkai Yin
32c4392b3b Update test cases (#6011) 
Update the automation test cases to pass the nightly testing

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-11 10:39:25 +08:00
Wenkai Yin
d1981d23b1 Update automation test cases (#5991) 
Longer the wait time to pass the nightly testing

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-10 10:38:48 +08:00
Qian Deng
4d601292d1 Add E2E test for helmchart (#5746) 
Add E2E test for helmchart repo

Signed-off-by: Qian Deng <dengq@vmware.com>
 2018-09-04 15:08:51 +08:00
wang yan
470000a9ec Deprecate unused robot cases 
Signed-off-by: wang yan <wangyan@vmware.com>
 2018-08-27 10:17:06 +08:00