Commit Graph

221 Commits

Author SHA1 Message Date
danfengliu
3db3f3a62e
add test cases for jenkins upgrade project, wrap test cases body into new keywords, so that case body appears only in one single place (#7243)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-28 14:37:03 +08:00
danfengliu
6b19b99c97
test case Disable Scan Schedule failed at page should contain part, it missing wait until and retry, so add one (#7228)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-27 15:33:31 +08:00
danfengliu
d9eb519e6c
Test case <List Helm Charts> failed occasionally, due to lacking of wail and retry for action word, so this case need to be refected. (#7165)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-18 18:06:46 +08:00
danfengliu
a618a2c2ac
Button was not clicked successfully in keyword < Delete Repo>, but the click action returned pass, so I add a checkpoint after clicking the delete button, make sure the pop info had disappeared, it means delete button was clicked successfully. (#7071)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-11 10:34:53 +08:00
danfengliu
98c6889053 Configuration item verify_remote_cert is no longer useful, so it was delete from data population script
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-03-05 15:53:14 +08:00
danfengliu
340577076c
add a jenkins job for migrate harbor from 1.6 to the latest, make some modification in prepare.py to adapt harbor 1.6 (#7025)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-02-27 14:27:39 +08:00
danfengliu
a1063edae6
Add GUI test script for new feature of master-role, without adding a new case for master-role, I add new test steps in old test case named Manage-Project-Members, because master-role is a sub function in project members. (#6945)
In this PR, I also modify a public action keyword to make it suitble for indefinite numbers of parameters.

Signed-off-by: danfengliu <danfengl@vmware.com>
2019-02-22 14:11:56 +08:00
danfengliu
b83cf2e4c0
GC function hbas been change, verify criteria must be changed by add manifests (#6934)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-02-15 11:06:22 +08:00
danfengliu
47530cd62e
remove some sleep and add retry common keyword (#6875)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-31 17:58:05 +08:00
danfengliu
e5efbfe490
add retry keyword for docker pull and push image command. (#6857)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-31 16:08:58 +08:00
danfengliu
9aeb626fe3
The former way to verify project creation is by API calling, but it's not a GUI operation, which is not a goal for operator, so I replace it with GUI verification (#6816)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-28 16:32:45 +08:00
danfengliu
923432a172
resort test case, 2 test cases failed due to unfinish chart data preparation, so resort the test cases, move the verification test case ahead of the 2 failed cases. (#6818)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-25 10:26:14 +08:00
danfengliu
f29960628a Keyword <Go Into Project> has modified, but verify.robot didn't adapt this keyword.
Modifications:
	1.Add paramenter hasimage in data.json
	2.Modify Harbor-Pages\Verify.robot to pass it to <Go Into Project>
	3.Add loop and exception-catch in <Go Into Project> to prevent using Sleep and failure by exception(this exception was caused by short time of paga loading)

Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-17 17:46:17 +08:00
Wenkai Yin
60425676ac
Merge pull request #6733 from danfengliu/Add-WaitUntil-In-Keywords-Stage2
Add wait until in <Multi-delete Object> and <Project Should Display>
2019-01-14 17:22:39 +08:00
danfengliu
73b9e95464 Add wait until in <Multi-delete Object> and <Project Should Display>
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-14 15:19:30 +08:00
danfengliu
de30438d01
modify a code error by copy mistake (#6736)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-14 11:02:11 +08:00
danfengliu
0b27037e34
Two modifications in PR:1. Due to GUI change on position of "project creation" configuration, script must be adjust with the corresponding change; 2. Fixed a issue of no exception caught when http request has error, all the system config will be set by a common request function. (#6715)
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-11 13:40:08 +08:00
danfengliu
d853adce46 Robot scripts refactor for keyword sign-in-harbor and other few keywords, mainly on replacing 'sleep' to 'wait until', and also add a checkpoint in "Go Into Project" keyword to verify the result of loading a project page.
Modify Switch To Log and Back To projects
Signed-off-by: danfengliu <danfengl@vmware.com>
2019-01-08 13:44:14 +08:00
FangyuanCheng
9a52059e89 fix nightly test of retag
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
2018-12-21 17:34:15 +08:00
danfengliu
3356368bff Add API test case assign system admin role. (#6413)
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-12-04 12:26:12 +08:00
danfengliu
b4c7663f5f
Add API test case scan all images and test case API test case list helm charts. (#6388)
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-12-03 17:05:06 +08:00
danfengliu
04fd4d444d
Add API test case for user view logs. (#6370)
Add API test case for user view logs.
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-29 18:27:53 +08:00
danfengliu
c4bf65162c
add api test case for garbage collection (#6366)
Add API test case for garbage collection, and add swagger.yaml, GC and chart feature were updated in swagger.yaml.
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-27 19:17:41 +08:00
danfengliu
ad77098acf
add test case project level policy content trust. (#6309)
Add test case project level policy content trust.
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-21 12:19:28 +08:00
danfengliu
5ceebcbb10
Add tese case of manage project memebers and modify (#6304)
Move admin_client to testutil.py as global parameter.
Change create_repository function name to push_image_to_project to make it reasonable.
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-20 14:24:13 +08:00
Fangyuan Cheng
bbee74eba4
Merge pull request #6298 from pureshine/retag-test
Add E2E test for retag
2018-11-19 12:52:48 +08:00
FangyuanCheng
34dee765ec Add E2E test for retag
Signed-off-by: FangyuanCheng <fangyuanc@vmware.com>
2018-11-19 12:20:19 +08:00
danfengliu
dcd34a37a9 add test case scan a not scanned image
Modify for codacy issues.
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-16 15:35:15 +08:00
danfengliu
1cc04183cb add test case for edit project creation;
fixed some space and import issues coddcy;
remove a lib;

Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-15 10:32:21 +08:00
danfengliu
7494050534 add test case name in API_DB
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-08 10:33:14 +08:00
danfengliu
a6151175e3 add lib for target
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-08 10:33:14 +08:00
Wenkai Yin
55c609b1a7 Update automation test case (#6221)
1. Add "Wait Until ..." to "Change User Role In Project"
2. Rename case name to "Scan Image On Push"

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-11-07 13:08:32 +08:00
Wenkai Yin
8c376ac55a
Merge pull request #6205 from ywk253100/181102_case
Check the vul data before running scan-on-push case
2018-11-05 21:09:26 +08:00
Wenkai Yin
40f8f4bc5d Check the vul data before running scan-on-push case
Update the automation case to wait until the vul data is ready before running the scan-on-push case

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-11-02 17:54:47 +08:00
danfengliu
1979d17550 add tc add-sys-label-to-tag and del-repo
Signed-off-by: danfengliu <danfengl@vmware.com>
2018-11-02 17:16:43 +08:00
danfengliu
894e0591bb add new api tests (#6127)
Add API test libraries which were based on swagger doc,
it's including user and project , also add one scenario
test case which is test_add_member_to_private_project to
verify a user can see a project when the uesr is the member of it.
Delete 2 old test case.Delete a quota.

Signed-off-by: danfengliu <danfengl@vmware.com>
2018-10-31 13:13:31 +08:00
wang yan
2ef11c396a Fix failure on GC test case
As the changes on scan all, the default schedule was removed from source code,
hence the gc job should be the first admin job, to change to job id to 1.

Signed-off-by: wang yan <wangyan@vmware.com>
2018-10-29 14:15:06 +08:00
Wenkai Yin
6c033574fa Update automation test case "Delete Multi Project" (#6116)
Add "Wait Until xxx" to wait the expected page appear before the next step to avoid the case failure

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-10-24 15:37:36 +08:00
Wenkai Yin
20a6a8738e
Merge pull request #6030 from wy65701436/add-gc-e2e
add gc e2e test case
2018-10-16 15:43:35 +08:00
wang yan
3ef52cafd4 Add gc e2e test case
Signed-off-by: wang yan <wangyan@vmware.com>
2018-10-16 14:31:57 +08:00
Wenkai Yin
16c9ffad2c Update automation test case "Project Level Image Serverity Policy" (#6037)
Currently, the case "Project Level Image Serverity Policy" uses the project library as the target project, but the project library has been set to scan image automatically when images are pushing, this will cause case failure. This commit creates a new project in the case to aviod the failure.

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-10-16 09:01:23 +08:00
Wenkai Yin
7e3ae5cb11 Update scan automation test case
Replace image hello-world with busybox as the hello-world has been scaned in the last case

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-10-12 11:22:43 +08:00
Wenkai Yin
00acb507ba Update automation test cases
Update the case to pass nightly testing for Harbor chart

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-10-11 15:29:43 +08:00
Wenkai Yin
32c4392b3b Update test cases (#6011)
Update the automation test cases to pass the nightly testing

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-10-11 10:39:25 +08:00
Wenkai Yin
d1981d23b1 Update automation test cases (#5991)
Longer the wait time to pass the nightly testing

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-10-10 10:38:48 +08:00
clouderati
587459df15 Replacing copyright notices with "Copyright Project Harbor Authors".
Signed-off-by: clouderati <35942204+clouderati@users.noreply.github.com>
2018-09-19 16:59:36 +00:00
Yan
002e5a2b70
Enable api tests in travis (#5900)
This commit is to enable parallel run jobs with travis, and add API for DB and API for LDAP in travis.

Signed-off-by: wang yan <wangyan@vmware.com>
2018-09-19 17:49:43 +08:00
Qian Deng
4d601292d1 Add E2E test for helmchart (#5746)
Add E2E test for helmchart repo

Signed-off-by: Qian Deng <dengq@vmware.com>
2018-09-04 15:08:51 +08:00
wang yan
470000a9ec Deprecate unused robot cases
Signed-off-by: wang yan <wangyan@vmware.com>
2018-08-27 10:17:06 +08:00
wang yan
aacbf229d6 deprecate ova for harbor repository
This commit is to remove the document/tests of ova from harbor repository as decide to deprecate
ova installer in the future release.

Signed-off-by: wang yan <wangyan@vmware.com>
2018-08-24 13:05:01 +08:00
Wenkai Yin
95c0c259ec Add E2E API test cases for replication based on labels (#5639)
This commit creates a new E2E API test case to verify the replication based on label

Signed-off-by: Wenkai Yin <yinw@vmware.com>
2018-08-16 18:36:27 +08:00
wangyan
397172e56a This is my commit message
Signed-off-by: wangyan <wangyan@vmware.com>

Update the verify case to use data.json instead of testdata.json
2018-08-12 19:07:36 -07:00
stonezdj(Daojun Zhang)
ecdfb8034f Add API Test setup and fix Add Member button verify (#5548) 2018-08-08 10:40:35 +08:00
stonezdj
af85522a05 Add API test to LDAP nightly test 2018-08-07 11:00:46 +08:00
Daniel Jiang
0a07f0e039
Merge pull request #5402 from stonezdj/api_test
Add harbor API test
2018-08-06 17:30:07 +08:00
Daniel Jiang
c5a79fb55b Add UAA e2e test cases (#5460)
This commit adds basic test cases to perform when Harbor is configured as
uaa_auth.  It has dependency on an internal UAA server.
2018-08-01 21:30:05 +08:00
stonezdj
edcb2fbf05 Add Harbor API Test based on python API
Correct swagger.yaml format
Add make task swagger_client to gen and install python client.
Add LDAP related Test
2018-08-01 10:43:23 +08:00
wangyan
5edd408d07 Add scripts to verify Harbor DB migration 2018-07-30 04:54:33 -07:00
wangyan
c3c56ada9a Add Notary server endpoint as a parameter for the CI test cases 2018-07-29 19:45:28 -07:00
Yan
85ded71816 Update e2e cases
refactor e2e test cases to support new CI pipeline
fix issues caused by recently UI change
2018-07-19 02:22:03 -07:00
sigsbee
889b36a944
Add data verify robot case after upgrade (#5207)
Add data verify e2e case after upgrade
2018-06-29 15:01:26 +08:00
sigsbee
673c1dac01 Add upgrade test scripts (#5119)
Add upgrade test data generate script and example data
2018-06-29 10:09:10 +08:00
sigsbee
a6f14c6d89
Update test case to increase passrate (#5083)
Update test case order to avoid scan on push fail
Add sleep time to avoid view scan results fail
Change keyword to wait unitl avoid delete operation fail
Change delete rule and repicate manual confirm to mouse down and up
2018-06-05 18:51:11 +08:00
sigsbee
0d4aaccd13
Add get version to LDAP and replication test group(#5076)
Add get harbor version test case to LDAP and replication test group
2018-06-04 14:24:47 +08:00
sigsbee
a07a0d09f8
Add get harbor version case (#5039)
Add get harbor version case
2018-06-01 14:38:10 +08:00
sigsbee
8d12960494
Fix robot keywords align with UI changes (#5036)
Fix robot keywords align with UI changes
fix replication case for new delete progress
2018-05-24 19:53:23 +08:00
sigsbee
8b6963f397
Update testcase for task progress (#4987)
update multi delete testcase for new delete progress
2018-05-24 13:07:19 +08:00
sigsbee
981743ada9 Fix nightly failures bases on latest UI change (#4870)
Fix up project level policy public
Change text to fix up pro replication rules add
2018-05-07 03:30:08 -07:00
sigsbee
9bf38c2486
Add autotest case (#4603)
Add test case large image replicate
Add test case Download CA
Add test case repo description
Add test case project level replication
Add test case repo size
Add test case statistics info
2018-04-25 16:24:11 +08:00
sigsbee
5bd9a99984
Fix up card view keyword (#4718)
Fix up card view keyword and failed test case
2018-04-19 10:07:55 +08:00
pfh
bd28eb4541 Add Filter Label about imgs 2018-04-17 10:08:19 +08:00
pfh
c67e1a2e4b Merge branch 'master' of https://github.com/vmware/harbor into fixIssue 2018-04-16 11:35:33 +08:00
pfh
c99e43674d add Filter Label about imgs 2018-04-16 09:54:27 +08:00
Deng, Qian
ddb5298ae6 Add testcase and doc for cardview 2018-04-12 19:55:46 +08:00
sigsbee
75e6b5d91c
Fix up keyword and test case (#4629)
Fix up keyword: push image with tag
Fix up case: Project Admin Add Labels To Repo
Fix up case: Proj Replication Jobs Log View
2018-04-12 11:42:54 +08:00
pfh
a9c7b34de9 Add case about project label 2018-04-09 16:10:07 +08:00
pengpengshui
73e32d1735
Merge pull request #4562 from pengpengshui/label
Modify label filter issue and add stick label to image case
2018-04-03 09:39:05 +08:00
pfh
e5a757d78d Modify label filter issue and add stick label to image case 2018-04-02 14:45:52 +08:00
sigsbee
8b32f56b64
Fix up ldap testcase (#4548) 2018-04-02 12:08:04 +08:00
sigsbee
9baee6b88c
Add LDAP case and add delay to project config to avoid case fail (#4486)
* Add LDAP case and add delay to project config to avoid case fail
2018-03-28 16:45:49 +08:00
wangyan
3ea42fd62c add read only case 2018-03-25 18:22:35 -07:00
sigsbee
8b739dcbbb Fix scan repo keyword and delete multi tag case (#4448) 2018-03-21 03:37:52 -07:00
sigsbee
340080f9a2 Fix view log test case (#4438) 2018-03-20 18:11:39 +08:00
sigsbee
80e39c39d3 Add replication autotest (#4406) 2018-03-20 13:25:03 +08:00
sigsbee
4ccd7e7cdf
Add vulneraibility case and add a testcase doc. (#4378)
Add disable schedule 
vulnerability data not ready 
can as an unprivileged user 
scan image with empty vul 
manual scan all
project level image serverity policy 
scan on push
2018-03-12 14:20:37 +08:00
wangyan
29bdcfe454 Add replication support for LDAP in nightly 2018-03-04 19:38:26 -08:00
Yan
c37b3748b9
Support replication test in nightly infrastructure (#4302) 2018-02-28 19:37:25 +08:00
sigsbee
15f4315b74 Modify test step to avoid an autotest bug (#4301) 2018-02-28 19:36:58 +08:00
sigsbee
9b9a44172f
Use two different tags in bat delete to avoid 500 error (#4216) 2018-02-02 17:43:11 +08:00
sigsbee
c436630f11 Fix failed auto test case (#4197) 2018-01-31 00:45:14 -08:00
sigsbee
eb98936845 Fix failed auto test case to suit new UI (#4188) 2018-01-30 03:04:24 -08:00
Deng, Qian
d536c64566 Update test cases for UI changes 2018-01-25 20:36:03 +08:00
Yan
932b06933b Move some tests into nightly from BAT 2018-01-25 18:09:39 +08:00
Yan
bb66a0cb52
Add harbor nightly and longevity test (#3940) 2018-01-23 13:04:19 +08:00
pfh
78dcdc409f Modify replication list to batch delection mode and add admin privilege to project replication module
Modity text about new replication rule
2018-01-16 15:53:11 +08:00
sigsbee
bf14cf4436 Add batch delete testcase (#3981) 2018-01-12 10:42:17 +08:00
Daniel Jiang
f8af1f275e
Merge pull request #3911 from stonezdj/ldap_search_level
Ambiguous UI and internal values ldap_scope
2018-01-08 14:53:55 +08:00
stonezdj
26b86984d2 Ambiguous UI and internal values ldap_scope #3764 2018-01-05 15:51:37 +08:00
pfh
162878a95c Modify test case and merge master 2018-01-05 15:39:52 +08:00
pengpengshui
c5e434bd14
Merge pull request #3859 from pengpengshui/batch-delection
Add batch-delete operation in project module, replication module and user module
2018-01-03 10:27:55 +08:00
Fuhui Peng (c)
d7c0bc5168 Add batch delection operation in project module, replication module and user module
Modify privilege about project module

Modify package version about harbor-ui

Fix case failed in new batch delection UI
2018-01-02 19:42:44 +08:00
stonezdj
b7670a39b3 Add ldap user to project member test 2017-12-27 16:44:40 +08:00
wangyan
cfce2ca4e9 Refine image tag name and script path when to build offline bundle 2017-12-18 23:50:48 -08:00
Deng, Qian
ccfd206ae2 Merge branch 'master' into metadata_description 2017-12-13 15:21:57 +08:00
Deng, Qian
b15acdf151 Add UI for metadata description 2017-12-08 15:05:52 +08:00
Steven Zou
82d842d77c
Merge pull request #3741 from wy65701436/add-tc-concourse
Add test cases for concourse-ci
2017-12-04 04:53:47 -06:00
wangyan
2d047d03e7 Add test cases for concourse-ci 2017-12-04 01:42:15 -08:00
stonezdj
73abc68cb4 Add LDAP e2e test 2017-11-30 18:53:53 +08:00
stonezdj
16243cfbbc Add LDAP remote certifcate validation
push test

Add unit test for ldap verify cert

remove common.VerifyRemoteCert

Update code with PR review comments

Add change ldaps config and add UT testcase for TLS feature

add ldap verfiy cert checkbox about #3513

Draft harbor ova install guide

Search and import ldap user when add project members

Add unit test case for SearchAndImportUser

ova guide

Add ova install guide

Add ova install guide 2

Add ova install guide 3

Call ValidateLdapConf before search ldap

trim space in username

Remove leading space in openLdap username

Remove doc change in this branch

Update unit test for ldap search and import user

Add test case about ldap verify cert checkbox

Modify ldap testcase
2017-11-24 12:41:51 +08:00
myufei
c66ab0d142 Add project level policy auto case 2017-11-07 15:04:27 +08:00
wangyan
8df0dae5ca Add OVA CI scripts 2017-11-03 03:40:56 -07:00
wangyan
31d92bf0c5 Enable https support in CI testing
Add harbor.ca with certutil into Chrome trust store, then can use Chrome headless to access harbor with https
And also update Chrome to latest stable version 62
2017-10-31 00:49:43 -07:00
myufei
1eca12ec28 Add delete project auto case 2017-10-30 16:34:49 +08:00
Wenkai Yin
2156750b04 Move certificate verification to target level
The certificate verification is on system level before this commit. Moving it
to target level makes the configuration more flexible for different targets.
2017-10-20 15:36:56 +08:00
myufei
161b2d62f9 add missing step in ldap user push image 2017-10-18 09:48:14 +08:00
myufei
b3755e1009 add ldap case 2017-10-17 15:05:16 +08:00
myufei
7eb036ddd3 fix scan tag case 2017-10-12 11:31:44 +08:00
wangyan
5afc0b5d28 update notary case 2017-09-18 15:46:40 +08:00
Deng, Qian
75566bffd1 refactory testcase for project member management and replace tab to space 2017-09-12 15:14:55 +08:00
Yan
b8ada80304 clean harbor containers in CI (#3137)
* update

* update

* update
2017-09-01 10:47:04 +08:00
Yan
f40eb993a0 [BAT] add drone to master (#2942)
* add drone to master

copyright

update

update

update

update

update

update build process

* update

* package migrator
2017-08-07 14:02:38 +08:00