Upstream/harbor
1
0
Fork 0
mirror of https://github.com/goharbor/harbor.git synced 2024-12-24 01:27:49 +01:00
Code Issues Projects Releases Wiki Activity
8,327 Commits 55 Branches 321 Tags 340 MiB
c729e3b9e0
Commit Graph

200 Commits

Author SHA1 Message Date
danfengliu
7d681c623b Add AWS-ECR and Google-GCR replication test into nighly tests. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-09-02 17:53:49 +08:00
danfengliu
68fd128252 Clair scan result is not accurate that when I script this case, only 6 high CVE-ID, but in today nightly result, one more CVE-ID popuped, so I have to add it. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-08-30 09:55:55 +08:00
danfengliu
7217ed5358 Add CVE Whitelist test cases into nightly test, first test case is system CVE Whitelist test. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-08-28 14:01:43 +08:00
danfengliu
2aa6f1aed7
Merge branch 'master' into add-sign-api-back-to-travis-despite-codacy-1 2019-08-16 16:28:49 +08:00
wang yan
ddb913f8d0 Add API test case sign image back to travis, despite codacy block it when pulling a pr. 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-08-16 01:26:36 -07:00
danfengliu
1f53a47102
add replication testcase in api_db.robot file (#8636) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-08-14 10:45:20 +08:00
danfengliu
b7803571d4
Currently, nightly test pipeline was only in one level category of auth_mode and upgrade, now we like to add a level base on the original level which is harbor deployment parameters. (#8398) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-08-01 15:10:54 +08:00
danfengliu
8665274406 In nighly test case <Project Level Image Serverity Policy>, scan result of haproxy image is nolonger high but medium, it should be a bug of clair, so we replace haproxy by postgres, and also we pull postgres with sha256 to make sure the image under test is alway the specific one. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-07-25 10:27:10 +08:00
danfengliu
9b61bf4fce
In nightly test case 'list helm chart', delete chart (#8280) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-07-17 15:32:10 +08:00
danfengliu
a8300d91e6
Add a nightly test case helm CLI, in this case, we verify help repo add and helm push. (#8240) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-07-16 14:00:30 +08:00
danfengliu
d8b76c482a
Add 2 UI test cases which is replication rule edit and delete. (#7904) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-06-03 16:58:24 +08:00
danfengliu
9d78038940
Population data tool - prepare.py has been adapted for the latest version due to API changing, but the old version still was needed in other place, so it should be add it back and give it a new name. (#7943) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-31 17:05:27 +08:00
danfengliu
496533296d
Jenkin job cd_daily_master failed due to sign image failure, but there're other failure for replicaiton NG, so API for replication NG need to be updated. (#7778) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-30 15:59:09 +08:00
danfengliu
e66d857fbc Add test case secret-verify for oidc-auth-mode feature by adding some keywords and one test cases. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-27 14:31:14 +08:00
danfengliu
a2b651969c
Fix bug for manage-project-member, due to keywords changed for oidc-auth-mode, test case manage-project-member should be debug at the same time. (#7888) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-24 15:22:28 +08:00
danfengliu
fed310a974
Add test case for oidc auth mode (#7860) 
* Nightly test case user-view-logs failed several times, after debugging, the reason is checking too fast although the operation has not finsished, so I add a checking for end of the operation.

Signed-off-by: danfengliu <danfengl@vmware.com>

* Add test case Manage-Project-Member for oidc auth mode Jenkins pipeline, this test case reuse the same test case in common file.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-23 15:43:59 +08:00
danfengliu
a503944110
OIDC authentication is a new feature in version 1.8.0, so add nightly GUI test cases for OIDC authentication scenario. (#7745) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-22 11:19:08 +08:00
danfengliu
dffb2bbd98 Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case <Replication Of Pull Images from DockerHub To Self> and <Replication Of Push Images from Self To Harbor> has been finished and ready for duty. Other modification is add retry for keywords in UserProfile.robot (#7611) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-09 15:44:48 +08:00
Steven Zou
b664b90b86
Merge pull request #7585 from steven-zou/add_get_jobs_API 
add get jobs API to provide powerful job stats management
 2019-05-08 17:17:33 +08:00
Steven Zou
2562146faf adjust the order of robot test case of API_DB 
Signed-off-by: Steven Zou <szou@vmware.com>
 2019-05-07 16:13:31 +08:00
danfengliu
e08c2e757e This API test script was blocked by a swagger error, now this error was fixed, so robot account script can be finished now. In swagger.yaml, robot account can be updated in "disbled" status, it's added into script. (#7636) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-05-06 11:34:11 +08:00
danfengliu
c4fbcb481e
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here is that test case endpoint add/edit/delete have been finished and ready for duty. (#7496) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-04-24 11:20:26 +08:00
danfengliu
c3c10a87b2
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipeline, and here test case add-replication-test-case-Endpoint-Verification has been finished and ready for duty. (#7472) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-04-23 15:33:04 +08:00
danfengliu
4e8d4fca85
Due to replication NG feature already in master branch, old replication UI test cases have been moved out of Jenkins pipline, and here test case Pro-Replication-Rules-Add has been finished and ready for duty. (#7453) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-04-22 09:58:02 +08:00
danfengliu
15846ac524
Feature - Replication was upgraded, so the corrsponding UI test cases are nolonger available any more, we left an empty Replication.robot file, then add new test cases step by step. (#7436) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-04-18 17:07:39 +08:00
wang yan
e017294f71 merge with master latest 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-04-17 17:52:39 +08:00
Wenkai Yin
174a1f5bfa Remove the E2E test cases for replication 
Remove the E2E test cases for replication

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-04-12 17:37:14 +08:00
danfengliu
08b346ee1e
Add API test case for retag, create a user and 2 projects by this new user, push image to 1st project, and retag this image to 2nd project. (#7300) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-04-11 15:05:46 +08:00
FangyuanCheng
82716d492d move vulnerability and gc ui 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2019-04-03 14:39:46 +08:00
danfengliu
3db3f3a62e
add test cases for jenkins upgrade project, wrap test cases body into new keywords, so that case body appears only in one single place (#7243) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-28 14:37:03 +08:00
danfengliu
6b19b99c97
test case Disable Scan Schedule failed at page should contain part, it missing wait until and retry, so add one (#7228) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-27 15:33:31 +08:00
danfengliu
d9eb519e6c
Test case <List Helm Charts> failed occasionally, due to lacking of wail and retry for action word, so this case need to be refected. (#7165) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-18 18:06:46 +08:00
danfengliu
a618a2c2ac
Button was not clicked successfully in keyword < Delete Repo>, but the click action returned pass, so I add a checkpoint after clicking the delete button, make sure the pop info had disappeared, it means delete button was clicked successfully. (#7071) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-11 10:34:53 +08:00
danfengliu
98c6889053 Configuration item verify_remote_cert is no longer useful, so it was delete from data population script 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-03-05 15:53:14 +08:00
danfengliu
340577076c
add a jenkins job for migrate harbor from 1.6 to the latest, make some modification in prepare.py to adapt harbor 1.6 (#7025) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-02-27 14:27:39 +08:00
danfengliu
a1063edae6
Add GUI test script for new feature of master-role, without adding a new case for master-role, I add new test steps in old test case named Manage-Project-Members, because master-role is a sub function in project members. (#6945) 
In this PR, I also modify a public action keyword to make it suitble for indefinite numbers of parameters.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-02-22 14:11:56 +08:00
danfengliu
b83cf2e4c0
GC function hbas been change, verify criteria must be changed by add manifests (#6934) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-02-15 11:06:22 +08:00
danfengliu
47530cd62e
remove some sleep and add retry common keyword (#6875) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-31 17:58:05 +08:00
danfengliu
e5efbfe490
add retry keyword for docker pull and push image command. (#6857) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-31 16:08:58 +08:00
danfengliu
9aeb626fe3
The former way to verify project creation is by API calling, but it's not a GUI operation, which is not a goal for operator, so I replace it with GUI verification (#6816) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-28 16:32:45 +08:00
danfengliu
923432a172
resort test case, 2 test cases failed due to unfinish chart data preparation, so resort the test cases, move the verification test case ahead of the 2 failed cases. (#6818) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-25 10:26:14 +08:00
danfengliu
f29960628a Keyword <Go Into Project> has modified, but verify.robot didn't adapt this keyword. 
Modifications:
	1.Add paramenter hasimage in data.json
	2.Modify Harbor-Pages\Verify.robot to pass it to <Go Into Project>
	3.Add loop and exception-catch in <Go Into Project> to prevent using Sleep and failure by exception(this exception was caused by short time of paga loading)

Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-17 17:46:17 +08:00
Wenkai Yin
60425676ac
Merge pull request #6733 from danfengliu/Add-WaitUntil-In-Keywords-Stage2 
Add wait until in <Multi-delete Object> and <Project Should Display>
 2019-01-14 17:22:39 +08:00
danfengliu
73b9e95464 Add wait until in <Multi-delete Object> and <Project Should Display> 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-14 15:19:30 +08:00
danfengliu
de30438d01
modify a code error by copy mistake (#6736) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-14 11:02:11 +08:00
danfengliu
0b27037e34
Two modifications in PR:1. Due to GUI change on position of "project creation" configuration, script must be adjust with the corresponding change; 2. Fixed a issue of no exception caught when http request has error, all the system config will be set by a common request function. (#6715) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-11 13:40:08 +08:00
danfengliu
d853adce46 Robot scripts refactor for keyword sign-in-harbor and other few keywords, mainly on replacing 'sleep' to 'wait until', and also add a checkpoint in "Go Into Project" keyword to verify the result of loading a project page. 
Modify Switch To Log and Back To projects
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-01-08 13:44:14 +08:00
FangyuanCheng
9a52059e89 fix nightly test of retag 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2018-12-21 17:34:15 +08:00
danfengliu
3356368bff Add API test case assign system admin role. (#6413) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2018-12-04 12:26:12 +08:00
danfengliu
b4c7663f5f
Add API test case scan all images and test case API test case list helm charts. (#6388) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2018-12-03 17:05:06 +08:00
danfengliu
04fd4d444d
Add API test case for user view logs. (#6370) 
Add API test case for user view logs.
Signed-off-by: danfengliu <danfengl@vmware.com>
 2018-11-29 18:27:53 +08:00
danfengliu
c4bf65162c
add api test case for garbage collection (#6366) 
Add API test case for garbage collection, and add swagger.yaml, GC and chart feature were updated in swagger.yaml.
Signed-off-by: danfengliu <danfengl@vmware.com>
 2018-11-27 19:17:41 +08:00
danfengliu
ad77098acf
add test case project level policy content trust. (#6309) 
Add test case project level policy content trust.
Signed-off-by: danfengliu <danfengl@vmware.com>
 2018-11-21 12:19:28 +08:00
danfengliu
5ceebcbb10
Add tese case of manage project memebers and modify (#6304) 
Move admin_client to testutil.py as global parameter.
Change create_repository function name to push_image_to_project to make it reasonable.
Signed-off-by: danfengliu <danfengl@vmware.com>
 2018-11-20 14:24:13 +08:00
Fangyuan Cheng
bbee74eba4
Merge pull request #6298 from pureshine/retag-test 
Add E2E test for retag
 2018-11-19 12:52:48 +08:00
FangyuanCheng
34dee765ec Add E2E test for retag 
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
 2018-11-19 12:20:19 +08:00
danfengliu
dcd34a37a9 add test case scan a not scanned image 
Modify for codacy issues.
Signed-off-by: danfengliu <danfengl@vmware.com>
 2018-11-16 15:35:15 +08:00
danfengliu
1cc04183cb add test case for edit project creation; 
fixed some space and import issues coddcy;
remove a lib;

Signed-off-by: danfengliu <danfengl@vmware.com>
 2018-11-15 10:32:21 +08:00
danfengliu
7494050534 add test case name in API_DB 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2018-11-08 10:33:14 +08:00
danfengliu
a6151175e3 add lib for target 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2018-11-08 10:33:14 +08:00
Wenkai Yin
55c609b1a7 Update automation test case (#6221) 
1. Add "Wait Until ..." to "Change User Role In Project"
2. Rename case name to "Scan Image On Push"

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-11-07 13:08:32 +08:00
Wenkai Yin
8c376ac55a
Merge pull request #6205 from ywk253100/181102_case 
Check the vul data before running scan-on-push case
 2018-11-05 21:09:26 +08:00
Wenkai Yin
40f8f4bc5d Check the vul data before running scan-on-push case 
Update the automation case to wait until the vul data is ready before running the scan-on-push case

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-11-02 17:54:47 +08:00
danfengliu
1979d17550 add tc add-sys-label-to-tag and del-repo 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2018-11-02 17:16:43 +08:00
danfengliu
894e0591bb add new api tests (#6127) 
Add API test libraries which were based on swagger doc,
it's including user and project , also add one scenario
test case which is test_add_member_to_private_project to
verify a user can see a project when the uesr is the member of it.
Delete 2 old test case.Delete a quota.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2018-10-31 13:13:31 +08:00
wang yan
2ef11c396a Fix failure on GC test case 
As the changes on scan all, the default schedule was removed from source code,
hence the gc job should be the first admin job, to change to job id to 1.

Signed-off-by: wang yan <wangyan@vmware.com>
 2018-10-29 14:15:06 +08:00
Wenkai Yin
6c033574fa Update automation test case "Delete Multi Project" (#6116) 
Add "Wait Until xxx" to wait the expected page appear before the next step to avoid the case failure

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-24 15:37:36 +08:00
Wenkai Yin
20a6a8738e
Merge pull request #6030 from wy65701436/add-gc-e2e 
add gc e2e test case
 2018-10-16 15:43:35 +08:00
wang yan
3ef52cafd4 Add gc e2e test case 
Signed-off-by: wang yan <wangyan@vmware.com>
 2018-10-16 14:31:57 +08:00
Wenkai Yin
16c9ffad2c Update automation test case "Project Level Image Serverity Policy" (#6037) 
Currently, the case "Project Level Image Serverity Policy" uses the project library as the target project, but the project library has been set to scan image automatically when images are pushing, this will cause case failure. This commit creates a new project in the case to aviod the failure.

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-16 09:01:23 +08:00
Wenkai Yin
7e3ae5cb11 Update scan automation test case 
Replace image hello-world with busybox as the hello-world has been scaned in the last case

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-12 11:22:43 +08:00
Wenkai Yin
00acb507ba Update automation test cases 
Update the case to pass nightly testing for Harbor chart

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-11 15:29:43 +08:00
Wenkai Yin
32c4392b3b Update test cases (#6011) 
Update the automation test cases to pass the nightly testing

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-11 10:39:25 +08:00
Wenkai Yin
d1981d23b1 Update automation test cases (#5991) 
Longer the wait time to pass the nightly testing

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-10-10 10:38:48 +08:00
clouderati
587459df15 Replacing copyright notices with "Copyright Project Harbor Authors". 
Signed-off-by: clouderati <35942204+clouderati@users.noreply.github.com>
 2018-09-19 16:59:36 +00:00
Yan
002e5a2b70
Enable api tests in travis (#5900) 
This commit is to enable parallel run jobs with travis, and add API for DB and API for LDAP in travis.

Signed-off-by: wang yan <wangyan@vmware.com>
 2018-09-19 17:49:43 +08:00
Qian Deng
4d601292d1 Add E2E test for helmchart (#5746) 
Add E2E test for helmchart repo

Signed-off-by: Qian Deng <dengq@vmware.com>
 2018-09-04 15:08:51 +08:00
wang yan
470000a9ec Deprecate unused robot cases 
Signed-off-by: wang yan <wangyan@vmware.com>
 2018-08-27 10:17:06 +08:00
wang yan
aacbf229d6 deprecate ova for harbor repository 
This commit is to remove the document/tests of ova from harbor repository as decide to deprecate
ova installer in the future release.

Signed-off-by: wang yan <wangyan@vmware.com>
 2018-08-24 13:05:01 +08:00
Wenkai Yin
95c0c259ec Add E2E API test cases for replication based on labels (#5639) 
This commit creates a new E2E API test case to verify the replication based on label

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2018-08-16 18:36:27 +08:00
wangyan
397172e56a This is my commit message 
Signed-off-by: wangyan <wangyan@vmware.com>

Update the verify case to use data.json instead of testdata.json
 2018-08-12 19:07:36 -07:00
stonezdj(Daojun Zhang)
ecdfb8034f Add API Test setup and fix Add Member button verify (#5548) 2018-08-08 10:40:35 +08:00
stonezdj
af85522a05 Add API test to LDAP nightly test 2018-08-07 11:00:46 +08:00
Daniel Jiang
0a07f0e039
Merge pull request #5402 from stonezdj/api_test 
Add harbor API test
 2018-08-06 17:30:07 +08:00
Daniel Jiang
c5a79fb55b Add UAA e2e test cases (#5460) 
This commit adds basic test cases to perform when Harbor is configured as
uaa_auth.  It has dependency on an internal UAA server.
 2018-08-01 21:30:05 +08:00
stonezdj
edcb2fbf05 Add Harbor API Test based on python API 
Correct swagger.yaml format
Add make task swagger_client to gen and install python client.
Add LDAP related Test
 2018-08-01 10:43:23 +08:00
wangyan
5edd408d07 Add scripts to verify Harbor DB migration 2018-07-30 04:54:33 -07:00
wangyan
c3c56ada9a Add Notary server endpoint as a parameter for the CI test cases 2018-07-29 19:45:28 -07:00
Yan
85ded71816 Update e2e cases 
refactor e2e test cases to support new CI pipeline
fix issues caused by recently UI change
 2018-07-19 02:22:03 -07:00
sigsbee
889b36a944
Add data verify robot case after upgrade (#5207) 
Add data verify e2e case after upgrade
 2018-06-29 15:01:26 +08:00
sigsbee
673c1dac01 Add upgrade test scripts (#5119) 
Add upgrade test data generate script and example data
 2018-06-29 10:09:10 +08:00
sigsbee
a6f14c6d89
Update test case to increase passrate (#5083) 
Update test case order to avoid scan on push fail
Add sleep time to avoid view scan results fail
Change keyword to wait unitl avoid delete operation fail
Change delete rule and repicate manual confirm to mouse down and up
 2018-06-05 18:51:11 +08:00
sigsbee
0d4aaccd13
Add get version to LDAP and replication test group(#5076) 
Add get harbor version test case to LDAP and replication test group
 2018-06-04 14:24:47 +08:00
sigsbee
a07a0d09f8
Add get harbor version case (#5039) 
Add get harbor version case
 2018-06-01 14:38:10 +08:00
sigsbee
8d12960494
Fix robot keywords align with UI changes (#5036) 
Fix robot keywords align with UI changes
fix replication case for new delete progress
 2018-05-24 19:53:23 +08:00
sigsbee
8b6963f397
Update testcase for task progress (#4987) 
update multi delete testcase for new delete progress
 2018-05-24 13:07:19 +08:00
sigsbee
981743ada9 Fix nightly failures bases on latest UI change (#4870) 
Fix up project level policy public
Change text to fix up pro replication rules add
 2018-05-07 03:30:08 -07:00
sigsbee
9bf38c2486
Add autotest case (#4603) 
Add test case large image replicate
Add test case Download CA
Add test case repo description
Add test case project level replication
Add test case repo size
Add test case statistics info
 2018-04-25 16:24:11 +08:00
sigsbee
5bd9a99984
Fix up card view keyword (#4718) 
Fix up card view keyword and failed test case
 2018-04-19 10:07:55 +08:00
pfh
bd28eb4541 Add Filter Label about imgs 2018-04-17 10:08:19 +08:00