Upstream/harbor
1
0
Fork 0
mirror of https://github.com/goharbor/harbor.git synced 2024-11-23 02:35:17 +01:00
Code Issues Projects Releases Wiki Activity
12,150 Commits 48 Branches 317 Tags 352 MiB
76851493e9
Commit Graph

1217 Commits

Author SHA1 Message Date
Wang Yan
732e9a21cd
updates on robot accounts (#13623) 
* updates on robot accounts

1, add patch method to refresh secret of a robot
2, fix robot account update issue
3, add editable attribute to handle the version 1 robot account
4, add duration for robot account
5, hide secret for get/list robot account

Signed-off-by: wang yan <wangyan@vmware.com>

* update code per review comments

1, change expirate creation func to AddDate().
2, remove the scanner duration specification, use the default value.

Signed-off-by: Wang Yan <wangyan@vmware.com>
 2020-12-01 18:31:34 +08:00
danfengliu
b36a4cf3be Fix scan all python test script issue of missing test step 
1. In scan all py-test, missing a important test step for checkin scan all status,
2. which indicate the ending of scan all job.
In swagger, ongoig field is missing in stats struct.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-11-27 20:27:37 +08:00
DQ
590212b485 Remove clair related code 
- clair code in harbor core
- clair code in frontend
- clair code in robotcase

Signed-off-by: DQ <dengq@vmware.com>
 2020-11-27 14:01:04 +08:00
Wang Yan
02846194e0 parent 8e61a3ea31 
author Wang Yan <wangyan@vmware.com> 1605849192 +0800
committer Wang Yan <wangyan@vmware.com> 1606361046 +0800

update code per review comments

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-11-26 14:10:12 +08:00
Wenkai Yin(尹文开)
fe8b628f0c
Merge pull request #13437 from ywk253100/200929_replication 
Refactor the replication execution
 2020-11-24 10:38:22 +08:00
Wenkai Yin
294385c34d Refactor the replication execution 
1. Use the task manager to manage the underlying execution/task
2. Use the pkg/scheduler to schedule the periodical job
3. Apply the new program model
4. Migration the old data into the new data model

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-11-23 14:24:10 +08:00
danfengliu
2bf89e9356 Add docker-hub login before docker-hub pull 
Due to docker-hub pull request rate limitation, we will use registed account to pull image
from docker-hub, therefore add docker-hub login in API tests.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-11-22 21:11:05 +08:00
danfengliu
5d0e6d6dbf Add p2p python test script 
Add p2p python test including create disstribution instance and project p2p preheat policy.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-11-12 05:41:35 +00:00
danfengliu
a70753d382 Add p2p python test script 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-11-11 14:55:23 +08:00
danfengliu
444de8536a Suppress urllib3 warning and fix nightly element locator issue and remove switch scanner 
1. Since upgrade python to 3.7, some urllib3 warnings come out during
   execution, because missing disconnection when using request by docker
   library, it's not affect script execution, therefore ignore them first.
2. Replication tests failed in nightly due to new UI code, some element
   locators are not valid anymore;
3. Remove switch scanner test steps, since Clair was removed.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-11-10 10:04:46 +08:00
danfengliu
1b127b16c5 Add API test scripts for tag immutability and scan signed image 
1. Add 7 API python test scripts for tag immutability;
2. Swagger file has object struct defination issue on imuutability policy rule, because
   this policy is in shared with retention rule, therefore, they should be unified to
   the same  type of rule;
3. Fixed a timeout issue of action keyword, waiting for a long period;
4. Add API test scripts for scan signed image.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-11-03 10:10:06 +00:00
danfengliu
691168b8cf
Merge pull request #13359 from danfengliu/optimize-upgrade-pipeline-of-pull-push-image 
Optimize upgrade pipeline script of push image
 2020-10-29 14:31:30 +08:00
danfengliu
ab3e24a2e3 Add proxy cache python test scipts and upgrade containerd 
Containerd in e2e image was using native one in ubuntu, it should be updated to the latest release.
And add proxy cache py-tests including pull image/manifest list by docker and ctr CLI.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-10-28 02:13:40 +00:00
danfengliu
cff4f529cd Optimize upgrade pipeline script of push image 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-10-26 15:16:18 +08:00
danfengliu
b388078a3e Upgrade containerd in e2e image 
Containerd in e2e image was using native one in ubuntu, it should be updated to the latest release.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-10-21 08:14:01 +00:00
danfengliu
6cdae44dc2
Merge pull request #13235 from danfengliu/fix-issue-for-upgrade-pipeline 
Replication UI changes break upgrade pipeline
 2020-10-14 12:06:24 +08:00
danfengliu
4bc7444602 Add UI test for LDAP admin group dn setting 
1. Verify LDAP group admin in UI;
2. Update LDAP group admin need to verify the AdminRoleInAuth, get current user will return this field as true.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-10-14 11:05:09 +08:00
danfengliu
8285db8def Replication UI changes break upgrade pipeline 
Remove duplicate keyword for editing replication rule.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-10-14 11:00:14 +08:00
Will Sun
3d5f8106f2
Merge pull request #13176 from AllForNothing/fix-nightly 
Fix nightly case for replication
 2020-09-30 18:29:36 +08:00
AllForNothing
3f213df595 Fix nightly case for replication 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-09-30 16:59:11 +08:00
danfengliu
baf7cda3e2
Merge pull request #13164 from danfengliu/add-build-package-action-in-github 
Add harbor build in git action workflow
 2020-09-30 09:55:26 +08:00
danfengliu
12f4f73c8a Add harbor build in gith action workflow 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-09-29 09:18:18 +00:00
danfengliu
fc5743b355
Merge pull request #13128 from danfengliu/fix-a-typo-in-upgrade-prepare-script 
Fix typo in upgrade prepare script
 2020-09-28 17:54:51 +08:00
danfengliu
e4894017cd Fix typo in upgrade prepare scritp 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-09-28 10:36:22 +08:00
AllForNothing
8d9a18b539 Update UI package to latest version 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-09-25 09:46:05 +08:00
Will Sun
18f41bad88
Merge pull request #13085 from AllForNothing/replication 
Add disable/enable function to replication rules
 2020-09-24 17:35:51 +08:00
danfengliu
48510fde08
Merge branch 'master' into add-2.1-upgrade-pipeline-in-nightly 2020-09-22 13:48:22 +08:00
danfengliu
ef53edf553 Recovery nightly setup 
1. Recovery nightly setup;
2. Add retry for replication rule selection.
3. Add retry for CNAB test.
4. Rerun keyword of push CNAB

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-09-22 02:41:50 +00:00
danfengliu
e2989e3b93 Add 2.0 & 2.1 upgrade pipeline in nightly 
1. Add 2.0 upgrade pipeline in nightly;
2. Add 2.1 upgrade pipeline in nightly.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-09-22 02:14:40 +00:00
AllForNothing
abdbd79ed4 Add disable/enable function to replication rules 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-09-17 10:29:31 +08:00
danfengliu
7e097afde8
Remove ca parameter in helm test case (#13069) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-09-16 16:31:45 +08:00
danfengliu
ebef11476a
Merge pull request #13002 from danfengliu/upgrade-docker-in-drone-dockerfile 
Create Dockerfile for E2E py-test
 2020-09-15 14:16:11 +08:00
danfengliu
d99ea887f1
Merge pull request #12989 from danfengliu/Add-Checkpoint-for-LDAP-group-py-test 
Add checkpoint for LDAP group py-test
 2020-09-15 14:15:31 +08:00
danfengliu
86fb6fdc65 Add checkpoint for LDAP group py-test 
LDAP group has different role, user in group has the same role, as groups with different roles were added in project
member list, user should act like in different roles. for admin and dev role, there should be checkpoints to verify priviledges of each own.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-09-14 21:15:09 +08:00
danfengliu
0dda643bc5 Create Dockerfile for E2E py-test 
Robot tests have been always executed in docker container, but API pyt-test is not,
so rebuild Dockerfile for it. During that, some of tools have been upgraded, so API py-test
 scripts need some modification.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-09-14 02:36:18 +00:00
stonezdj(Daojun Zhang)
97b9cc2d5e
Merge pull request #12997 from stonezdj/200902_ldap_filter_fail 
Add ldap filter syntax validation when create search filter
 2020-09-09 16:21:01 +08:00
danfengliu
f90f9a6984
Fix nightly issue caused UI changing (#13006) 
Some UI text display changed, it cause failure in nightly.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-09-09 15:20:13 +08:00
stonezdj
b9752f3112 Add ldap filter syntax validation when create search filter 
Correct ldap search filter is enclosed with '(' and ')'
Search ldap group with the ldap group base DN instead of group DN
Fixes #12613 LDAP Group Filter and Group Base DN have no affect

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2020-09-09 10:07:07 +08:00
danfengliu
34e2490154 Fix git action CI python package installation 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-09-03 20:41:55 +08:00
danfengliu
2ca5c11675 Fix git action CI missing python sit packages issue 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-09-03 17:34:51 +08:00
danfengliu
931bde0df8 Fix issue of missing swagger package for python API test 
1. Python API test can't import packages from swagger maker, the reason is that python install packages to site-packages instead of dist-packages,
   so the current solution is to copy pakages from site back to dist, I will try to find a way of using ENV variable to fix this;

2. Remove a python library no longer be used.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-09-02 15:18:23 +08:00
danfengliu
00180b2a6f Add P2P Preheat UI Test 
1. Fix ldap script issue, test case name should be in lowercase;
2. Add manifest list checkout point for proxy cache issue;
3. Add P2P Preheat policy CRUD Test.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-08-28 11:34:32 +08:00
stonezdj(Daojun Zhang)
b2ed195df5
Merge pull request #12785 from danfengliu/add-distribution-ui-test 
Add distribution UI test in nightly
 2020-08-21 14:19:05 +08:00
danfengliu
37e280c49f Add proxy-cache and distribution UI test in nightly 
1. Add proxy-cache UI test in nightly;
2. Add distribution UI test in nightly.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-08-21 02:08:06 +00:00
danfengliu
143062fe20
Merge pull request #12788 from danfengliu/upgrade-robotframework-in-git-action 
upgrade robotframework in git action
 2020-08-20 20:08:36 +08:00
danfengliu
3f5bd9ae0a Re-script ldap API script 
1. upgrade robotframework in git action
2. Re-script ldap API script:test_assign_role_to_ldap_group.py

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-08-20 11:24:51 +00:00
Dirk Mueller
08a4d8efd2
Update to golang 1.14.7 (#12809) 
We should use a golang that isn't having security issues.

This includes:
* go1.14.6 (released 2020/07/16) includes fixes to the go command, the
compiler, the linker, vet, and the database/sql, encoding/json,
net/http, reflect, and testing packages. See the Go 1.14.6 milestone on
our issue tracker for details.

* go1.14.7 (released 2020/08/06) includes security fixes to the
encoding/binary package. See the Go 1.14.7 milestone on our issue
tracker for details (CVE-2020-16845)

Signed-off-by: Dirk Mueller <dirk@dmllr.de>
Signed-off-by: Dirk Mueller <dmueller@suse.com>
 2020-08-20 15:38:35 +08:00
Wang Yan
60427e7187
build base image in CI (#12750) 
In git action, use the local build base images instead of pulling from docker hub.

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-08-18 14:11:52 +08:00
He Weiwei
f659523f50 fix(scan): fix the permission checking for artifact scanning 
Closes #12778

Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2020-08-17 09:55:38 +00:00
He Weiwei
f309896f2f refactor(api): generate project apis by go-swagger 
Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2020-08-15 16:10:57 +00:00
danfengliu
5cb239af1e
Fix echo parameter issue (#12775) 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-08-14 10:23:58 +08:00
danfengliu
e1eac2b4d0
Merge pull request #12688 from danfengliu/fix-upgrade-test-wrong-keyword-issue 
Fix wrong keyword issue in upgrade test
 2020-08-14 10:11:37 +08:00
Daniel Jiang
83de495147
Merge pull request #12772 from reasonerjt/update-root-cert-test 
Refresh CA cert
 2020-08-13 18:22:19 +08:00
Daniel Jiang
376929d58e Refresh CA cert 
This commit refresh the harbor_ca.crt and revert the changes to generate a new CA each time in the test script.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2020-08-13 08:43:07 +00:00
danfengliu
8f116d7b38 Add exec priviledge to integration script 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-08-13 08:15:42 +00:00
danfengliu
601d1ef0eb Add git/golang/dns config in drone image 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-08-13 07:24:54 +00:00
danfengliu
9a2188641d Upgrade python and robot for drone build 
1.Separate Dockerfile to drone and nightly e2e, one Dockerfile should cover
 both scenarios, it will be resolved later;
2.Fix docker api err type issue, API error has no message attibute;
3.Upgrade docker in nightly e2e images.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-08-12 10:26:12 +00:00
danfengliu
ab7767f539 Fix wrong keyword issue in upgrade test 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-08-10 14:47:38 +00:00
danfengliu
4968b6619b Recovery drone build script 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-08-10 14:23:44 +00:00
danfengliu
859ff2e1ef Modify e2e image for drone build 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-08-10 11:40:26 +00:00
danfengliu
07f5f549d0 Fix LDAP API test issue by upgrading python 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-08-09 06:37:28 +00:00
danfengliu
0521f9eed5
Merge pull request #12626 from danfengliu/upgrade-robotframework-and-libs 
Upgrade robot-framework and Selenim library
 2020-08-06 16:01:35 +08:00
danfengliu
3b8a2890f9 Upgrade robot-framework and Selenium library 
1. Upgrade robot-framework to 3.1 and Selenium library to 4.4.0.
2. Fix a registry issue for clear filter text input.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-08-06 07:25:53 +00:00
Flávio Ramalho
3d3fabbd20
Make notary-remove-image-signature more flexible (#12536) 
Instead of explicitly defining the expect path to /usr/local/bin/expect,
use the env command, so the expect executable is searched for and launched
from wherever it is first found.

Signed-off-by: Flávio Ramalho <framalho@suse.com>
 2020-07-31 15:49:45 +08:00
danfengliu
da662f52d5
Merge pull request #12607 from danfengliu/add-gcs-s3-push-based-replic-test 
Add GCS&S3 push-based replicatiton tests
 2020-07-30 09:40:21 +08:00
danfengliu
8328e95b63 Add GCS&S3 push-based replicatiton tests 
1. Add GCS push-based replicatiton tests;
   There is an issue against it, so it's commented out;
2. Add S3 push-based replicatiton tests;
3. Add filter registry keyword;

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-07-29 12:44:49 +00:00
danfengliu
658cfcf3a2
Merge pull request #12427 from danfengliu/add-checkpoint-to-gc-untag-case 
Add checkpoint of no deletion for untagged image
 2020-07-28 21:27:26 +08:00
danfengliu
5d3080c2c2 Add checkpoint of no deletion for untagged image 
1. Add checkpoint of no deletion for untagged image
2. rebase master.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-07-28 15:21:28 +08:00
stonezdj
7d97ae6ea2 Set LDAP groupname when PopulateGroup 
Search ldap group name with default ldap group attribute name
fixes #10940

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2020-07-28 10:27:15 +08:00
danfengliu
f030de59a5
Merge pull request #12537 from danfengliu/add-oidc-user-onboard-test 
Add OIDC user onboard test in nightly
 2020-07-27 14:39:04 +08:00
danfengliu
8a691c5df1 Add OIDC user onboard test in nightly 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-07-27 13:56:18 +08:00
Wang Yan
eeb8fca255
add debugging env for GC time window (#12528) 
* add debugging env for GC time window

For debugging, the tester/users wants to run GC to delete the removed artifact immediately instead of waitting for two hours, add the env(GC_BLOB_TIME_WINDOW) to meet this.

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-07-22 11:09:01 +08:00
danfengliu
4bdcc1fa7d
Merge pull request #12515 from danfengliu/fix-replication-robot-script 
Fix issues in replication tests
 2020-07-20 16:19:19 +08:00
danfengliu
e20cb51d6b Fix issues in replication tests 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-07-20 09:42:55 +08:00
Ziming Zhang
8857e89e40 feature(redis) support redis sentinel 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2020-07-19 21:19:03 +08:00
danfengliu
af3a638980
Merge pull request #12498 from danfengliu/add-push-based-replication-test 
Add push-based replication test in nightly
 2020-07-17 11:01:38 +08:00
danfengliu
aa43afb601 Add push-based replication test in nightly 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-07-16 19:50:42 +08:00
Wang Yan
bad8f026fc
upgrade golang to v1.14.5 (#12489) 
Signed-off-by: wang yan <wangyan@vmware.com>
 2020-07-16 16:20:54 +08:00
Wang Yan
d73265d10d
revise gc job to align non blocking gc (#12439) 
two phases:
1, mark, select the gc candidates bases on the DB and mark them as status delete.
2, sweep, select the candidate and mark it as status deleting and remove it from backend and database.

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-07-16 14:35:54 +08:00
AllForNothing
706c6bdb2b Rename project role 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-07-08 09:15:01 +08:00
danfengliu
0cb378d8fa Verify error message when deleting signed image 
1. Verify error message when deleting signed image;
2. Add test case - Replication From Dockerhub;

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-07-06 10:56:31 +08:00
AllForNothing
fff6f7529a Replace all whitelist with allowlist 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-06-24 16:17:17 +08:00
danfengliu
a8f159728b Add API E2E pytest of GC with untag flag enabled 
1. Fix issue of keyword Go Into Repo, the verification logic could be more strict;
2. Add API E2E pytest of GC with untag flag enabled;
3. Add sleep in test_user_view_logs.py for delete log ocurred;
4. Test Case - Tag CRUD is not stable. Although add button was clicked, but the tag was'nt added successfully.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-06-23 14:48:04 +08:00
danfengliu
c5e5e9ec9f
Merge pull request #12234 from danfengliu/fix-keyword-go-into-repo 
Add helm and helm3 CLI py-test
 2020-06-16 17:28:47 +08:00
danfengliu
67ccc98c58 Add helm and helm3 CLI py-test 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-06-16 16:27:31 +08:00
danfengliu
1948a3ef66 Fix nightly issue caused by GC and CVE UI changed 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-06-13 20:28:27 +08:00
danfengliu
4b5080d44e Add singularity py-test 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-06-10 11:09:41 +08:00
Wang Yan
c993103e01
enable storage driver of gcs and oss (#12180) 
Add go build tags for gcs and oss, otherwise these drivers cannot be registered and the error "StorageDriver is not regsited: GCS" will raise on registryctl launch under the setting of GCS storage.

These build tags are designed in the distribution, just refer to https://github.com/docker/distribution/blob/release/2.7/registry/storage/driver/gcs/gcs.go#L13

Pin the google cloud API to a old version is because distribution depends on it, otherwise go mode will use v0.17.0 that go-migrate is using as the dependency version, but this version will break the compile process with following error:
harbor/pkg/mod/google.golang.org/cloud@v0.0.0-20151119220103-975617b05ea8/storage/acl.go:65:16: invalid type assertion: v.(map[string]<inter>) (non-interface type *storage.ObjectAccessControl on left)
that's bacause another dependency google.golang.org/cloud requires the pinned version of google.golang.org/api.

The pinned package should be removed once https://github.com/docker/distribution/pull/3019 is merged, and distribution ships their v2.8.0

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-06-09 00:57:27 +08:00
danfengliu
e020b90bf0 add oras cli py-test 
1. Add oras cli py-test;
2. Add env for notary url, allow to input different notary port instead of solid 4443;
3. Add retry for keyword Cannot Pull Image and make it longer during retry.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-06-08 11:10:07 +08:00
danfengliu
3f2850ffdf Scan result behavior changed after trivy upgrade 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-06-04 16:25:21 +08:00
danfengliu
ceaa0a57b3 Add replication schedule test 
1. Add replication schedule test;
2. Add some sleep after project creation before push image to avoid push image v2 error.
   It fixed issue# 12094: Scan image vmware/photon:1.0 return unsupported occasionally.
3. Add some sleep in test_user_view_logs.py, can't get operation logs sometimes.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-06-02 15:51:10 +08:00
danfengliu
a732292941
Merge pull request #12002 from danfengliu/add-retry-for-go-into-index-2 
Add retry for keyword go into index
 2020-05-29 10:01:20 +08:00
danfengliu
5d8a308158 Add retry for keyword go into index 
1. Add retry for keyword go into index;
2. Add retry for keyword go into project.
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-05-27 08:55:58 +00:00
danfengliu
ba48e55e4e Move docker prune cmd outside of api common install shell script 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-05-22 04:06:25 +00:00
danfengliu
a07cc7bb2a
Merge pull request #11967 from danfengliu/fix-nightly-log-verification 
Modify nightly quotas error message verification
 2020-05-20 14:38:37 +08:00
danfengliu
2b9a01ce59
Merge pull request #11963 from danfengliu/add-schedule-test-in-ui-test 
Add Scan schedule test in nightly
 2020-05-20 14:36:29 +08:00
danfengliu
b4a54adfeb Add Scan schedule test in nightly 
1. Add Scan schedule test in nightly;
2. Remove redundancy steps when create a new project;

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-05-20 12:16:33 +08:00
danfengliu
2fb90cf258 Modify nightly quotas error message verification 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-05-19 14:59:21 +08:00
wang yan
65f2abcb39 enable full set of conformance test 
1, enable test of Content Discovery
2, enable test of Content Management

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-05-15 14:12:34 +08:00
danfengliu
ac19f02bf5 Enhance verificaton for tag retention pytest 
1. Modify scan related keywords, some of keywords are not effective.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-05-12 16:41:47 +08:00
danfengliu
a8cfb40cc2
Merge pull request #11812 from danfengliu/fix-issue-of-gc-untag-case 
Fix issue of GC untag images case
 2020-04-30 20:17:37 +08:00
Daniel Jiang
2f2fe8ba68
Merge pull request #11801 from wy65701436/conformance-ci 
add conformance test to CI
 2020-04-30 19:49:07 +08:00
Daniel Jiang
8b9dc1fac6
Merge pull request #11779 from bitsf/cicd_fix_base_image 
feat(cicd) add build date for base images
 2020-04-30 19:13:16 +08:00
danfengliu
d10dfc8167 Fix issue of GC untag images case 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-04-30 16:10:03 +08:00
danfengliu
768b292b15 Add double confirm for clicking untag checkbox 
1. Add double confirm for clicking untag checkbox;
2. Add retry for waiting GC completion;

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-04-29 20:21:07 +08:00
wang yan
d9773248e2 add conformance test to CI 
1, add a specrate git action for conformance test
2, use the OCI testing code to test Harbor master code on push

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-04-29 16:08:27 +08:00
danfengliu
cd0463047b Add tag for ui test case of add nuew user 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-04-28 19:47:47 +08:00
danfengliu
f8ce615e12 Add ctr command for pulling oci 
1. Manifest list can be pulled by ctr;
2. ui-test missing key checkpoint, fix it by add checking scan detail result;
3. add tag retension untag image test;

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-04-28 15:01:49 +08:00
danfengliu
16f6ad3688
Merge pull request #11768 from AllForNothing/nightly-login 
Add new nightly case  admin add new users
 2020-04-28 14:57:37 +08:00
Ziming Zhang
3c51ab556e feat(cicd) add build date for base images 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2020-04-28 12:56:37 +08:00
AllForNothing
8ff4003438 Add new nightly case admin add new users 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-04-28 11:10:06 +08:00
He Weiwei
8458f980d0 fix(swagger): enable security in swagger.yaml 
1. Enable `security` in the swagger.yaml.
2. Include `basic` auth in `security` to make the generated python
client by `swagger-codegen-cli` work with basic authorization.
3. Include `anonymous` auth in `security` to make APIs of v2.0 generated
by `goswagger` work with `security` middleware.

Closes #11771

Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2020-04-28 02:34:34 +00:00
DQ
599ca98c09 Hidden veriify client cert verfiy option 
Remove to avoid replication access core from external_url issue

Signed-off-by: DQ <dengq@vmware.com>
 2020-04-23 10:14:36 +08:00
Ziming Zhang
41e8bb91ce fix some cicd problems 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2020-04-21 14:34:45 +08:00
danfengliu
fdded0744a Clean up gitaction env and add tag for pytest 
1. Add docker prune cmd to release some space;
2. Add tag for pytest in case of debugging requirement;
3. Replace image to smaller size in robot account pytest;

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-04-20 18:19:28 +08:00
Danfeng Liu (c)
1cc5d0261b Add robot-account verification for upgrade test 
1. Add Clair should be default scanner in upgrade test;
2. Add tag retention verification in upgrade test;
3. Add tag retention verification in upgrade test;
4. Add tag Immutability verification in upgrade test;
5. Add webhook verification in upgrade test;
6. Add CVE whitelist in upgrade test;

Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2020-04-16 22:16:33 +08:00
Yogi_Wang
589d05a894 nightly move switch scanner case to mutiple-scanner file 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2020-04-16 10:05:08 +08:00
Yogi_Wang
8835813439 [test-case] add switch scanner case 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2020-04-15 14:53:17 +08:00
jwangyangls
5cf72e3ba4
Merge pull request #11616 from jwangyangls/fix-bug-case 
[Test] Fix view log error
 2020-04-14 21:41:47 +08:00
Yogi_Wang
6799f7c4ad [test] Fix view log error 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2020-04-14 21:08:08 +08:00
AllForNothing
46320641b4 Add new nightly case for GC untagged images 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-04-14 09:25:06 +08:00
Will Sun
009662a317
Merge pull request #11426 from AllForNothing/nightly-tag 
Add new nightly cases for tag CRUD
 2020-04-13 12:15:18 +08:00
danfengliu
a869bba59f Modify quota error info due to product changed 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-04-10 21:06:05 +08:00
Wenkai Yin
812ea7814b Uncomment the verification logic in the ldap group test case 
Fixes #11094, uncomment the verification logic in the ldap group test case

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-04-10 14:02:11 +08:00
danfengliu
5ec8ff70b2
Merge pull request #11474 from danfengliu/add-multi-scanner-robot 
Add Multi-Scanner test file
 2020-04-08 20:45:05 +08:00
danfengliu
66dfd59c80 Add Multi-Scanner test file 
1. Add Multi-Scanner test file for harbor is deployed with multi scanners;
2. Modify notary doc description;
3. Add paragraph for e2e-api-python-based-scripting-guide;
4. Fix delete project issue;
5. Remove count qoutas in nightly and modify some of it;
6. Add Trivy in git hub offline action;

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-04-08 16:26:31 +08:00
AllForNothing
e342b4ef0b Add new nightly cases for tag CRUD 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-04-08 09:56:27 +08:00
Ziming Zhang
572ebef685 feat(cicd) parameterize docker base image and external url 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2020-04-08 00:21:47 +08:00
Yogi_Wang
3775509ce5 Update APIs to only accept encoded repository name 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2020-04-07 22:40:39 +08:00
Qian Deng
1c8d5c6df5
Add spaces (#11471) 
Fix typo of spaces cause failure

Signed-off-by: DQ <dengq@vmware.com>
 2020-04-07 17:47:23 +08:00
DQ
1ae50b8d66 Remove migrator flags in script 
Because migrator tool removed

Signed-off-by: DQ <dengq@vmware.com>
 2020-04-07 14:57:10 +08:00
Daniel Jiang
db10720e80
Merge pull request #11406 from reasonerjt/reenable-token-auth-for-cli-new 
Reenable token auth for cli
 2020-04-07 08:55:25 +08:00
He Weiwei
80027c3b86
Merge pull request #11397 from ywk253100/200402_chart_api 
Add a seperated swagger file for chart API
 2020-04-07 00:05:49 +08:00
wang yan
44825e819e deprecate quota count on artifact 
Fixes #11241

1, remove count quota from quota manager
2, remove count in DB scheme
3, remove UI relates on quota
4, update UT, API test and UI UT.

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-04-06 16:56:11 +08:00
Wenkai Yin
8f8b4d5e8d Add a seperated swagger file for chart API 
Add a seperated swagger file for chart API as these APIs have no version

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-04-06 16:30:26 +08:00
Daniel Jiang
08f9ffa000 Reenable token auth for cli 
Docker CLI fails if it's not logged in upon seeing "basic" realm challenging while pinging the "/v2" endpoint. (#11266)
Some CLI will send HEAD to artifact endpoint before pushing (#11188)(#11271)

To fix such problems, this commit re-introduce the token auth flow to the CLIs.

For a HEAD request to "/v2/xxx" with no "Authoirzation" header, the v2_auth middleware populates the
"Www-Authenticate" header to redirect it to token endpoint with proper
requested scope.

It also adds security context to based on the content of the JWT which has the claims of the registry.
So a request from CLI carrying a token signed by the "/service/token" will have proper permissions.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2020-04-04 00:05:58 +08:00
Yogi_Wang
2610fe530f [Test Case] Add nightly case for CVE 
1. add nightly case for cve
2. change translate words
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2020-04-03 16:59:45 +08:00
jwangyangls
4ea7b13215
Merge pull request #11385 from jwangyangls/nightly-case-trivy-2 
[Nightly] Project Level Image Serverity Policy
 2020-04-02 11:14:21 +08:00
danfengliu
aa26e624b9
Merge pull request #11379 from danfengliu/add-nightly-test-of-push-helm-chart 
Add nightly test of push helm chart
 2020-04-02 10:29:21 +08:00
Yogi_Wang
01f8291bb7 [Nightly] Project Level Image Serverity Policy 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2020-04-02 10:16:57 +08:00
danfengliu
e3b31bb8dd Add nightly test of push helm chart 
1. Add push helm chart oci test in nightly;
2. Modify archive icon locator xpath;

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-04-01 18:53:19 -07:00
danfengliu
f11e713ada
Merge pull request #11380 from jwangyangls/nightly-case-trivy-1 
[Nightly] add case about trivy
 2020-04-01 22:45:40 +08:00
Qian Deng
b1284da96b
Merge pull request #11360 from ninjadq/rever_chart_api_change 
Rever chart api change
 2020-04-01 18:58:57 +08:00
Yogi_Wang
24b57715ab [Night] add case about trivy 
`
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2020-04-01 17:06:34 +08:00
AllForNothing
e6e3f0a6af Fix nightly cases for webhook 
Signed-off-by: AllForNothing <sshijun@vmware.com>
 2020-04-01 16:27:40 +08:00
danfengliu
7ad3b500ac
Merge pull request #11356 from danfengliu/add-nightly-test-of-push-manifest-list 
Add nightly test case of push docker manifest list
 2020-04-01 15:21:05 +08:00
danfengliu
8f9822d168 Add nightly test case of push docker manifest list 
1. Add notary tool in E2E Dockerfile;
2. Add push docker manifest list test in nightly;
3. Modify document for e2e user guide;
4. Add CNAB tool  in E2E Dockerfile;

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-04-01 06:51:13 +00:00
Daniel Jiang
eebcc8fc9a
Merge pull request #11184 from bitsf/fix_build_base_image 
feat(cicd) fix build base image
 2020-04-01 12:28:14 +08:00
DQ
cd69339014 Fix API TEST for chart Version 
Fix api test for chart b/c revert the api

Signed-off-by: DQ <dengq@vmware.com>
 2020-04-01 11:55:22 +08:00
Wenkai Yin(尹文开)
4faff18b2d
Merge pull request #11339 from ywk253100/200328_limit_offset 
Add "order by" clause to avoid the duplicat rows
 2020-03-30 17:14:44 +08:00
Wenkai Yin
fb975d902c Add "order by" clause to avoid the duplicat rows 
Add "order by" clause to avoid the duplicat rows: https://www.postgresql.org/docs/9.6/queries-limit.html

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-03-30 16:42:43 +08:00
Ren Maosheng
759c759b58 Adding tests for native docker registry APIs exposed by Harbor 
Adding a test for listing repositories
Adding a test for list image tags for specified repo.

Signed-off-by: Ren Maosheng <renmaosheng@gmail.com>
 2020-03-29 08:27:13 -07:00
danfengliu
77e3b0d828 Fix nightly ldap test cases 
1. Modify robot account test, checkout "Never Expired" button;
2. Modify OIDC get user API;
3. Modify verification for docker pull command;

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-03-27 20:24:43 +08:00
Wang Yan
eccb8aa708
append pull permission for push policy (#11303) 
Fixes #11225
As registry changes to basic auth, the push action lost the pull permission.
Add it in the robot security context.

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-03-27 17:10:04 +08:00
Yogi_Wang
1f3e00c782 [Nightly] Add case for trivy 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2020-03-27 15:20:39 +08:00
Ziming
9440df1090
feat(cicd) fix redis container version for test (#11105) 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2020-03-27 10:54:52 +08:00
jwangyangls
96572c3c86
Merge pull request #11254 from jwangyangls/nightly-case-3 
[Fix]   Fix issue 2.0
 2020-03-26 12:14:37 +08:00
Yogi_Wang
cba4490a5a [Fixed] Fix bug for 2.0 and add case for trivy 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
1.add case for trivy
2.vunerbility refresh bug
3.scan mutiple artifact
4.fix global search bug
5.disable delete tag btn when remove immutable tag
6.cancel selectRow when add label or remove label;fix #11195
7.fix cron tootip
 2020-03-26 11:39:57 +08:00
Ziming Zhang
ae7834af0b feat(cicd) fix build base image 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2020-03-26 10:55:40 +08:00
danfengliu
6ccaaf1efa Remove some content of verification for artifact addtion 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-03-26 10:03:30 +08:00
danfengliu
08a070a124 Modify nightly test case for user view logs and other 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-03-23 14:19:13 +08:00
danfengliu
deb225b0f2 Modify elements locator in nightly tests 
1. Modify get signature API in sign image test;
2. Modify locator for tag in artifact list;

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-03-22 20:48:37 +08:00
danfengliu
35786e8efd Analyze nightly failed cases 
1. Modify delete repo button locator;
2. Modify verifcation for GC log result message;
3. Modify locator for tag retention.
4. Add empty Trivy pipeline.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-03-21 11:30:15 +08:00
Yogi_Wang
13ae4482ab [OCI] Change nightly case and change delete artifact words 
1.nightly: fix tag retention and immutable tag case xpath
2.nightly: fix the part of delete repo button xpath
3.nightly: fix the api version when GC
4.nightly: fix add label of artifact xpath
5.text:   change delete artifact show words
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2020-03-20 15:59:16 +08:00
danfengliu
3de8175d1b
Merge pull request #11145 from danfengliu/debug-nighlty-keyword-go-into-repo 
Modify Nightly popular Keyword Go-Into-Repo
 2020-03-19 17:41:49 +08:00
danfengliu
fedfae71ff Modify Nightly popular Keyword Go-Into-Repo 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-03-19 17:09:16 +08:00
Wang Yan
dc6eec8a73
Enable API logs test case (#11142) 
1, enable user view log api test case
2, update project logs api permission check
3, use project ctl instead in permission check base method

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-03-19 14:56:37 +08:00
Qian Deng
cf90ec27f2
Merge pull request #10706 from ninjadq/enable_tls_on_all_components 
Enable tls on all components
 2020-03-18 21:25:40 +08:00
jwangyangls
1d435bc246
Merge pull request #11086 from danfengliu/add-api-test-of-add-addition 
Modify api test for test step of add addition
 2020-03-18 20:12:46 +08:00
DQ
b93092e012 Add tls for trivy 
Add trivy tls cert files
Add tivey tls env and config
enhance gencert

Signed-off-by: DQ <dengq@vmware.com>
 2020-03-18 19:22:10 +08:00
DQ
c5d73e6a0c Add switch to https 
use switch to make decision whether mTLS or server TLS

Signed-off-by: DQ <dengq@vmware.com>
 2020-03-18 19:22:10 +08:00
DQ
02dea3ad2c Add: mTLS configuration on CI 
Add internal_tls on ci
generate certs for ci

Signed-off-by: DQ <dengq@vmware.com>
 2020-03-18 19:22:09 +08:00
Wang Yan
b4e941e961
drop table access log in migration (#11118) 
Use the audit log instead, the access log table should be dropped after migration

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-03-18 19:04:38 +08:00
danfengliu
77e9fc38c7 Modify api test for test step of add addition 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-03-18 17:32:10 +08:00
Wenkai Yin(尹文开)
b0e87b46e4
Merge pull request #11003 from danfengliu/modify_api_test_scan_image_2 
Modify API test for scan image since harbor v2 API presented
 2020-03-18 11:00:55 +08:00
danfengliu
995ce30c58 Modify API test for scan image since harbor v2 API presented 
1. System level Scan All;
2. Scan An Image Artifact

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-03-18 10:15:07 +08:00
Wenkai Yin
3aca33acde Clean up some TODO items 
1. Remove blob fetcher and cache

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-03-17 19:01:38 +08:00
Wenkai Yin
e33b2984ce Add create/delete tag API test case 
Add create/delete tag API test case

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-03-16 21:32:34 +08:00
danfengliu
843b05c2d3 Add script of push cnab bunlde API test 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-03-16 17:37:16 +08:00
danfengliu
42956c74bb
Merge pull request #11018 from danfengliu/add-verification-for-helm-api-test 
Add verfication for helm API test
 2020-03-16 10:17:37 +08:00
Wenkai Yin
c6940e8184 United error response format for management APIs (legacy and v2.0 APIs) 
United error response format for management APIs (legacy and v2.0 APIs)

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-03-13 22:00:08 +08:00
He Weiwei
28dcb5ad59
test(quota): enable quota test case in API robot (#11039) 
Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2020-03-12 11:50:30 +08:00
danfengliu
f8811102da Add verfication for helm API test 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-03-11 15:05:16 +08:00
Wang Yan
bd7940217a
upgrade golang version to v1.13.8 (#11006) 
The vesrion contains two security bug fix - CVE-2020-0601, CVE-2020-7919

More details, see the golang milestone:

https://github.com/golang/go/issues?q=milestone%3AGo1.13.8+label%3ACherryPickApproved

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-03-11 12:20:06 +08:00
Wang Yan
f49994d81d
enable garbage colloection api test case (#11000) 
Signed-off-by: wang yan <wangyan@vmware.com>
 2020-03-11 11:19:29 +08:00
Daniel Jiang
e4ad35a655
Merge pull request #10924 from bitsf/fix_version_tag 
use unified version as tag name
 2020-03-09 23:48:23 +08:00
Ziming
b0c9ec7855
feat(ci) enable trivy in CI test (#10992) 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2020-03-09 22:20:11 +08:00
Ziming Zhang
200c352c35 feat(cicd) use unified version as tag name 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2020-03-09 15:30:03 +08:00
wang yan
1b84bfde23 add trivy into offline/online package 
Package trivy adapter image into offline image and ship dev to hub

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-03-09 13:56:49 +08:00
Daniel Jiang
0f0e27179b Remove dependency on travis-ci 
Github actions work fine, we no longer needs travi-ci to trigger the
tests.
This commit removes it.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2020-03-09 01:30:38 +08:00
danfengliu
e49ac2f9e9 Add API test python script - Push chart file by Helm3 chart command line 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-03-05 14:58:36 +08:00
danfengliu
2d6e18a895 Add API test case of pushing index by docker manifest 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-03-02 06:31:59 +00:00
wang yan
79cf21f82f add tag controller 
use the tag controller to handle CRUD of tags, especially the delete scenario, it could validate
the immutable and signature. And move the code of tag handling from artifact controller to tag controller

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-02-28 11:42:10 +08:00
danfengliu
6709dfb13f
Merge pull request #10833 from danfengliu/update-repository-and-artifact-api-test-cases 
Update existing API tests for API V2.0
 2020-02-27 10:38:27 +08:00
danfengliu
c283a02e5f Update existing API tests for API V2.0 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-02-26 21:38:39 +08:00
Ziming Zhang
94230b5e19 feat(cicd) fix some build problem 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2020-02-25 12:05:39 +08:00
danfengliu
4933bb634f Upgrade repository API tests to V2.0 
Enable _xsrf in cookies in swagger.yaml, so that scripts don't have to handle it.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-02-24 18:15:25 +08:00
Wenkai Yin
bd204464f3 Remove dead code 
Remove dead code

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-02-23 17:11:46 +08:00
He Weiwei
88fcacd4b7
feat(middleware): add blob middlewares (#10710) 
1. Add middleware to record the accepted blob size for stream blob
upload.
2. Add middleware to create blob and associate it with project after blob upload
complete.
3. Add middleware to sync blobs, create blob for manifest and associate blobs
with the manifest after put manifest.
4. Add middleware to associate blob with project after mount blob.
5. Cleanup associations for the project when artifact deleted.

Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2020-02-20 23:20:34 +08:00
Ziming
0bc32410f3
Merge pull request #10742 from bitsf/oci_tag_retention 
requirement(oci) implement tag retention for oci
not include ChartClient yet
 2020-02-20 20:31:49 +08:00
danfengliu
03668ad372 Build python swagger client for V2.0 
Add v2 swagger.yaml python library.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-02-20 18:06:54 +08:00
Yogi_Wang
99d02a14f5 Fix issue from louis and improve artifact list 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2020-02-20 10:15:33 +08:00
Ziming Zhang
94e23dc954 requirement(oci) implement tag retention for oci 
Change-Id: Ib36660835d2666b35124e66254c33b5fc19aaf77
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2020-02-20 00:43:20 +08:00
Wenkai Yin
94787ea60d Bump up the version of legacy APIs to v2.0 
Bump up the version of legacy APIs to v2.0

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-02-14 13:16:30 +08:00
Wenkai Yin(尹文开)
d66c1a4a21
Merge pull request #10612 from ywk253100/200202_replication_basic_auth 
Do enhancement for the registry authorizer
 2020-02-11 22:09:40 +08:00
Wenkai Yin
a4ebbc6ecf Do enhancement for the registry authorizer 
This commit introduces a new wrapper authorizer which can authorize the request according to the auth scheme automatically

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-02-11 21:21:49 +08:00
danfengliu
d1b5bd5d9c Fix project quotas API test issue 
In project quotas API test, pull images from goharbor namespace instead of library:
1. Replace image source in API test;
2. Modify criteria for verify project configuration modification.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-02-06 16:43:08 +08:00
danfengliu
a7472a7a66
Merge pull request #10614 from danfengliu/fix-test-steps-desc-in-robot-account-api-test 
Fix description of test in robot account API test
 2020-02-04 20:07:14 +08:00
danfengliu
66eff99c7f Fix description issue of test in robot account API test and issue of Helm3 test 
1. Fix issue that test step descriton was mismatch with test step;
2. Wrong helm command was used in Helm3 test, replace helm with helm3;
3. In API test, images were pulled from docker-hub registry, images size changed sometime, so we like to use internal registry.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2020-02-04 17:26:52 +08:00
Wenkai Yin
ef3af85a5b Register registry handler with the new methods of Route 
Register registry handler with the new methods of Route

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-02-03 16:55:08 +08:00
Daniel Jiang
2064a1cd6d Switch to basic authentication for registry 
1. Add basic authorizer for registry which modify the request
to add basic authorization header to request based on configuration.
2. Set basic auth header for proxy when accessing registry
3. Switche the registry to use basic auth by default and use the basic
authorizer to access Harbor.
4. Make necessary change to test cases, particularly
"test_robot_account.py" and "docker_api.py", because the error is
changed after siwtched to basic auth from token auth.  #10604 is opened
to track the follow up work.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2020-01-31 21:46:47 +09:00
Wenkai Yin(尹文开)
a1b25e1fec
Switch to new registry API handlers (#10596) 
Switch to new registry API handlers

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2020-01-30 21:21:07 +08:00
Daniel Jiang
5f8acc3896 Add middlewares for permission checking for v2 API 
When the registry shifts from token auth to basic auth, we'll use the middleware to check permission.
This commit add middlewares for populate the artifact info and check
permission based on request to /v2/* api via security context

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2020-01-27 12:53:15 +08:00
Ziming Zhang
9f1d538b5f feat(cicd): try fix sometimes docker push time out 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
Change-Id: I67193a7c5b80d169237a884895627f68a1f65933
 2020-01-20 11:57:03 +08:00
Daniel Jiang
c4dd6c077e
Merge pull request #10456 from bitsf/stop_travis 
feat(cicd):stop use travis
 2020-01-18 02:59:41 +08:00
Ziming Zhang
45113ea8e1 feat(cicd) use a smaller docker image for test 
Change-Id: Ie8f365e7271bfda24ae965aaca0e55d1099c1d68
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2020-01-17 13:09:31 +08:00
Danfeng Liu (c)
d9c0a4ae67 Switch registry from docker-hub ot internal harbor registry 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
:q
 2020-01-17 10:43:20 +08:00
Ziming Zhang
e4eec83e21 feat(cicd):stop use travis 
Change-Id: I8a979e4c63801c70ea0b520c864131901ab39506
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2020-01-15 18:16:03 +08:00
Ziming Zhang
a8e99ef7be fix(cicd) Use fixed golang version 1.13.4 and fail early 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
Change-Id: Ic6a5930c879e3d344ce8a747e226514b4500324c
 2020-01-14 16:35:26 +08:00
Danfeng Liu (c)
d02f15fb0f Add retry for prject list display 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2020-01-13 15:44:31 +08:00
Danfeng Liu (c)
ea01a236a5 Add retry when fail to find replication 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2020-01-08 17:08:42 +08:00
danfengliu
7edac6d8e8
Merge pull request #10403 from danfengliu/add-test-case-tag-immutability 
Add nightly test case for tag immutability
 2020-01-07 14:04:19 +08:00
Daniel Jiang
a5f8111fd0
Merge pull request #10329 from wy65701436/expir-robot 
add expiration data time when to create a robot account
 2020-01-06 17:30:48 +08:00
Danfeng Liu (c)
9d651128d6 Add nightly test case for tag immutability 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2020-01-06 15:54:08 +08:00
Danfeng Liu (c)
07b005bcda add checkpoint and retry for click add member button 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2020-01-03 15:40:46 +08:00
wang yan
a0f3709b3c add expiration data time when to create a robot account 
Update API of creating robot accout, user can specify expiration time per account.

Signed-off-by: wang yan <wangyan@vmware.com>
 2020-01-03 13:47:06 +08:00
Danfeng Liu (c)
1cdf7253cd Repull image when error 
Docker pull command was enclosed to one keyword, in this keyword,
there're retry and log record.

Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-12-31 14:30:26 +08:00
danfengliu
bbe40a551e
Merge pull request #10374 from danfengliu/refresh-project-quotas-list 
Refresh project quotas list at regular time
 2019-12-30 17:03:53 +08:00
danfengliu
79f93af471
Merge pull request #10333 from danfengliu/add-time-waiting-for-tag-switch 
Replace keyword without waiting to one which had waiting
 2019-12-30 14:45:24 +08:00
Danfeng Liu (c)
9dbb04925c Refresh project quotas list at regular time 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-12-30 14:11:19 +08:00
danfengliu
de2ec7d063 Replace keyword without waiting to one which had waiting 
1. Replace all keywords without using waiting;
2. Add a debug line in Go Into Repo for UI hung trouble shooting.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-12-27 17:13:25 +08:00
danfengliu
933dc91ba5 Notary test failed in Helm Pipeline 
In Helm pipeline, harbor access address is by domain name instead of IP, so cert directory should be created by domain name.

Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-12-27 17:02:28 +08:00
danfengliu
d46b663778 Remove whitelist verifcation since it's not ready 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-12-27 10:24:45 +08:00
Danfeng Liu (c)
76cbcfcbb9 Refect upgrade script, population will be distinguished by harbor version. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-12-26 14:08:47 +08:00
danfengliu
95ddf6d9b3 Refect keyword of Go Into Reop 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-12-24 16:39:37 +08:00
Wenkai Yin(尹文开)
c1522d3c36
Merge pull request #10261 from stonezdj/20191211_ldap_group_admin_dn 
Fix admin permission not revoked when removed from LDAP admin group(Do Not Merge)
 2019-12-24 14:37:28 +08:00
stonezdj
6313a55219 Fix admin permission not revoked when removed from LDAP admin group 
Seperate the HasAdminRole(In DB) with the privileges from external auth, and use user.HasAdminPrivilege to check

Signed-off-by: stonezdj <stonezdj@gmail.com>
 2019-12-20 13:12:22 +08:00
Danfeng Liu (c)
8bfc5d12c3 Change parameter image to optional 
1. Change parameter in Keyword Body Of Admin Push Signed Image to an
optional one.
2. Loose the restriction for Quotas error message verification.
3. Get cert for notary from API instead of local file.

Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-12-19 16:54:59 +08:00
danfengliu
99713dbec6
Merge pull request #10302 from danfengliu/switch-repository-filter-in-nightly-test-case 
Use repository filter in the list above
 2019-12-18 16:51:16 +08:00
danfengliu
66859d35d8
Merge pull request #10299 from danfengliu/add-remove-notary-signature-nightly-testcase 
Add notary remove signature test case in nightly
 2019-12-18 16:50:57 +08:00
Danfeng Liu (c)
70a40b87a8 Use repository filter in the list above 
Nigthly test case failures always caused by filter issue, as Shijun
adviced, it's better to use  repository filter in the list above.

Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-12-18 13:50:49 +08:00
Danfeng Liu (c)
9961d8b0d6 O 
Add notary remove signature test case in nightly

1. Update E2E image Dockerfile for adding notary CLI;
2. Add test case of remove notary signature.

Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-12-17 21:00:08 -08:00
Ziming
e32649adb4 enhance[cicd] introduce github action for CICD 
In order to replace travis.
Implement 5 CI jobs
- UTTEST
- APITEST_DB
- APITEST_LDAP
- OFFLINE
- UI_UT

Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2019-12-17 18:36:33 +08:00
Danfeng Liu (c)
364df7a767 Modify robot keyword from press key to press keys 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-12-12 17:01:31 +08:00
danfengliu
6d80803dbb
Merge pull request #10091 from danfengliu/update-e2e-dockerfile-to-latest 
Maintain E2E image Dockerfile
 2019-12-12 14:04:53 +08:00
Danfeng Liu (c)
fb80ef9cb9 Update E2E image Dockerfile 
1. update and docker-compose;
2. Install helm and helm3.
3. dockerd-entrypoint.sh has been modify by commit image manually, so it should be updated.
4. Keyword <Get Matching Xpath Count> is no longer recommended in
library Selenium2Library. After Dockerfile is updated and image is going
to be rebuiled, library Selenium2Library has be updated to 3.0.0, but
not 1.8.0, so keyword must be upgraded.

Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-12-12 10:31:15 +08:00
Steven Zou
7bf9372f32 chore[api]:rename API folder to api 
- update swagger yaml file reference in `Makefile`
- update swagger yaml file reference in `README`
- update swagger yaml file reference in `docs/configure_swagger.md`
- update swagger yaml file reference in `make/photon/portal/Dockerfile`
- update swagger yaml file reference in `tests/swaggerchecker.sh`

Signed-off-by: Steven Zou <szou@vmware.com>
 2019-12-11 17:41:27 +08:00
Wang Yan
2a63382236
Merge pull request #10047 from bitsf/makefile_clean 
optimize the makefile process
 2019-12-05 19:03:19 +08:00
Ziming Zhang
332f88ec8c add make clean 
Change-Id: Ibe806972a19cd69bfd90be051cdc340c4d7c6afb
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2019-12-05 14:44:07 +08:00
Wenkai Yin(尹文开)
d145f4baf4
Merge pull request #10034 from ywk253100/191128_clean 
Clean up admiral-related code
 2019-12-04 17:33:31 +08:00
Danfeng Liu (c)
7dbe84d9c6 1. Add nightly test case of Robot-Account; 2. In Go Into Repo keyword, filter element should not be clicked since list in loading state, so add some sleep and waiting for the cirlce icon is gone; 3. Move read-only test case in the end of common.robot. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-12-03 14:46:54 +08:00
Danfeng Liu (c)
156b1b0687 As we like to use a local registry for nightly quotas test, so that the sample image will not be update without noticed, so modify quotas test case to use local image for pulling. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-11-29 14:56:41 +08:00
Yogi_Wang
97e08c50c9 refactor project tab 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-11-29 12:02:08 +08:00
Wenkai Yin
dd2bc0ecef Clean up admiral-related code 
Clean up admiral-related code as it's useless

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-11-28 17:28:54 +08:00
Will Sun
6c7ef36e60
Merge pull request #10005 from AllForNothing/remove-lib 
Move lib into src for better UI building
 2019-11-28 09:47:18 +08:00
danfengliu
82b7e02baf
Merge pull request #10018 from danfengliu/add-loop-for-waiting-completion-of-replication 
[Nightly Test]Add a replication scope keyword for waiting the completion of replication result
 2019-11-27 17:51:37 +08:00
Will Sun
a52b99e180
Merge branch 'master' into remove-lib 2019-11-27 17:44:30 +08:00
Danfeng Liu (c)
1698cc034a Add a replication scope keyword for waiting the completion fo replication result. All replication test case must use this keyword to verify if image was pulled. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-11-27 15:51:03 +08:00
Daniel Jiang
f25bacc5bc
Merge pull request #10010 from wy65701436/upgrade-golang-1.13 
Bump up golang version to v1.13.4
 2019-11-27 10:35:35 +08:00
sshijun
c692f5c67e Move lib into src for better UI building 
Signed-off-by: sshijun <sshijun@vmware.com>
 2019-11-27 09:59:06 +08:00
wang yan
7b664f64f1 Bump up golang version to v1.13.4 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-11-26 19:18:45 +08:00
Danfeng Liu (c)
b7bd34d181 It's a temporary solution for quotas case, after internal registry in service, image size will not change any longer. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-11-26 15:27:50 +08:00
danfengliu
6d382bdb18
Merge pull request #9982 from danfengliu/add-restrict-xpath-for-go-into-project 
Modify keyword Go Into Project and Quota case
 2019-11-25 18:09:50 +08:00
Danfeng Liu (c)
f0750f73de 1. Add element verification for keyword Go Into Project; Make big loop effective by stop assert in keyword Retry Double Keywords When Error; 2. Quota string verification is too restrictive, make it loose a little. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-11-25 17:44:15 +08:00
Wang Yan
4121545e46
Merge pull request #9972 from wy65701436/cp-9967 
inject base image version tag when to build offline package
 2019-11-25 14:35:13 +08:00
wang yan
b2b8fd1806 udpate base image to 1.10.0 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-11-22 16:47:32 +08:00
Danfeng Liu (c)
08bedb8376 Add a big loop for keyword Go Into Project to make sure if project was not found, search it again 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-11-22 15:04:22 +08:00
Danfeng Liu (c)
b8a7598ffa The criteria of keyword Go Into Project is not strong for verify if it's in project repositroy page, so fix this issue by way of 'Retry Double Keywords When Error'. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-11-22 12:07:20 +08:00
Wang Yan
abfd634644
Merge pull request #9935 from wy65701436/enable-migrator-master 
enable build migrator in master
 2019-11-21 18:51:36 +08:00
Danfeng Liu (c)
6e1f560544 Modify 2 points, 1st is add wait time right after scan all; 2nd is add name length for project name to avoid naming repeatly. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-11-21 15:12:21 +08:00
wang yan
e5bd87ec5d enable build migrator in master 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-11-20 14:59:35 +08:00
Wang Yan
5c16cbc7b6
Merge pull request #9922 from wy65701436/push-online 
upload online installer with drone
 2019-11-19 17:53:22 +08:00
wang yan
17f126c5f7 upload online installer with drone 
1, upload online installer and signature
2, inject npm registry server when to build offline

Signed-off-by: wang yan <wangyan@vmware.com>
 2019-11-19 17:01:31 +08:00
Danfeng Liu (c)
44b9a8d70a The xpath of repository filter behavior may cause hung-up of repositoy search operation, so change it by the filter in the list column. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-11-19 14:52:56 +08:00
Danfeng Liu (c)
1a6d9536d6 As the background of clair updated was disabled, and we populate clair db right after harbor deployed with existing data, so all clair relevant test cases should be update as the data of this clair population. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-11-15 18:08:38 +08:00
Daniel Jiang
2fcd174e4b
Merge pull request #9828 from wy65701436/cii-docker-base 
add base images when to build harbor assets
 2019-11-15 14:24:11 +08:00
Yogi_Wang
e951ceb31c Modify scan now nightly case 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-11-13 10:09:03 +08:00
wang yan
47793e77e3 update base file name ane pass base version to build file 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-11-12 19:12:49 +08:00
sshijun
14364727ae Nightly case for tag-retention 
Signed-off-by: sshijun <sshijun@vmware.com>
 2019-11-11 16:58:33 +08:00
Yogi_Wang
58936aae42 Modify nightly case of scanner 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-11-11 13:19:37 +08:00
Daniel Jiang
890dcb915e Bump up Clair to v2.1.0 
This commit fixes #9677

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2019-11-06 14:16:02 +08:00
Steven Zou
4b335b79d5
Merge pull request #9693 from steven-zou/fix/issue_#9606_update_API_swagger 
update API swagger file
 2019-11-06 11:06:02 +08:00
Steven Zou
0ebeaa10df update API swagger file 
- add scanners mgmt related API
- add scan related API
  - trigger scan
  - get report
  - get log text stream
  - get scan all metrics
- update the scan_overview in the tag getting API
- fix #9606

Signed-off-by: Steven Zou <szou@vmware.com>
 2019-11-05 22:20:14 +08:00
Wang Yan
27cb25cc04
Merge pull request #9400 from ninjadq/inject_certs_to_non_root 
Inject certs to non root
 2019-11-05 14:49:08 +08:00
Wang Yan
5961c4d72a
Merge pull request #9625 from ywk253100/191028_e2e 
Add e2e test case for health check API
 2019-11-05 14:34:36 +08:00
Wang Yan
3f39b0ba4f
Merge pull request #9550 from ninjadq/enable_https_by_default 
Enable https by default
 2019-11-04 16:51:33 +08:00
DQ
a0462f0baa Change the clair container to non root user 
Signed-off-by: DQ <dengq@vmware.com>
 2019-11-04 11:36:39 +08:00
danfengliu
e28aae0c90
Merge pull request #9685 from danfengliu/replication-dest-url-changed 
Modify nightly test case due to replication rule element is modified from selector to input
 2019-11-01 15:23:45 +08:00
Danfeng Liu (c)
d8c49d9834 Replication rule element is modified from selector to input, so nightly test case should be updated. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-11-01 13:08:47 +08:00
Will Sun
1c8105e837
Merge pull request #9663 from AllForNothing/nav-modify 
Modify harbor-shell UI
 2019-11-01 10:26:54 +08:00
sshijun
b4fa143aa4 Modify harbor-shell UI 
Signed-off-by: sshijun <sshijun@vmware.com>
 2019-11-01 09:31:33 +08:00
DQ
873d9f5b82 Enable https by default 
1. Umcomment https related configs
2. Remove the https prepare related thing in ci

Signed-off-by: DQ <dengq@vmware.com>
 2019-10-31 20:58:09 +08:00
Wang Yan
fa784d7514
Merge pull request #9649 from wy65701436/fix-9081 
add ldflags for harbor compiler and linker
 2019-10-31 19:14:16 +08:00
Steven Zou
7b6e83090e create API folder to keep API swagger files 
- create API folder
- move harbor API swagger file to API/harbor
- add scanner adapter open API swagger file to API/scanner
- update protal build Dockerfile
- update swagger explorer build command in Makefile

Signed-off-by: Steven Zou <szou@vmware.com>
 2019-10-30 21:41:03 +08:00
wang yan
253e87d186 inject ldflags for harbor compiler and linker 
1, replace the UIVERSION file with ldflags, which is generarted by make to inject into the UI core.
2, inject additional ldflags for harbor compiler

Signed-off-by: wang yan <wangyan@vmware.com>
 2019-10-30 18:31:42 +08:00
Wenkai Yin
e20b538141 Add e2e test case for health check API 
Add e2e test case for health check API

Signed-off-by: Wenkai Yin <yinw@vmware.com>
 2019-10-29 13:48:06 +08:00
Danfeng Liu (c)
76c5cb85ec Before user keyword Enable Self Reg, explore should be opened and navigate to harbor log in page. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-10-28 17:24:07 +08:00
Danfeng Liu (c)
afdf262ca6 In nightly test case of project members, xpath locator of remove a member is not strong enough for location, it used index of elemment, so it should be update by the meaning of the btn. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-10-28 14:52:24 +08:00
Steven Zou
5c4c04a122
Merge pull request #9602 from heww/upgrade-clair-adapter 
Upgrade clair adapter to v1.0.0
 2019-10-28 12:19:28 +08:00
jwangyangls
e8554b9d66
Merge pull request #9587 from jwangyangls/add-webhook-tests-1.10 
Add webhook nightly case
 2019-10-28 10:05:16 +08:00
He Weiwei
28e0c0693b Upgrade clair adapter to v1.0.0 
1. Upgrade clair adapter to v1.0.0.
2. Make the clair adapter which installed by harbor immutable and using internal registry address.
3. Add support to build clair adapter image from binary.
4. Switch to ScannerPull action when make authorization for the scan request.

Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2019-10-26 17:25:36 +00:00
Yogi_Wang
988279cdcb Add webhook nightly case 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-10-25 15:25:32 +08:00
Ziming Zhang
7de8ce7472 add gpg sign 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
Change-Id: I32d13be2f5b5f383113582a4b1ad5f74bdc7546b
 2019-10-24 11:38:38 +08:00
jwangyangls
72776ed68c
Merge pull request #9515 from jwangyangls/fix-nightly-words 
Modify the words of setting cli secret
 2019-10-23 11:41:49 +08:00
wang yan
3e826c4e80 update query in the immutable delete manifest middleware 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-10-22 19:37:20 +08:00
Wang Yan
d503f2a245
Merge pull request #9489 from reasonerjt/bump-up-golang 
Bump up golang to 1.12.12
 2019-10-22 10:54:35 +08:00
Yogi_Wang
7b93e845e1 Modify the words of setting cli secret 
Signed-off-by: Yogi_Wang <yawang@vmware.com>
 2019-10-22 10:11:25 +08:00
Daniel Jiang
dbe6ebceec Bump up golang to 1.12.12 
Bump up the golang for compiling the binaries to 1.12.12
This commit also includes some minor changes to Makefile to fix issue in
building the binary files.

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2019-10-21 15:55:58 +08:00
Danfeng Liu (c)
7a7ac09fa0 Currently, self registration was disabled after harbor deployment, so all nightly db.robot test cases failed. To correct this, we should enable self-registration before running db test cases. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-10-21 14:34:34 +08:00
danfengliu
37030e513d
Merge pull request #9467 from danfengliu/modify-quota-error-msg 
Fix nightly test case failure by project quota error message changed
 2019-10-18 16:40:46 +08:00
wang yan
b7e336691d fix drone ci docker compose version out of date 
1, update docker-compose to latest
2, print log when to package offline installer

Signed-off-by: wang yan <wangyan@vmware.com>
 2019-10-18 13:34:48 +08:00
Danfeng Liu (c)
732eda4196 Project quotas counting result is growing a little bit for unknow reason, images redis size was caculating from 25.8 to 25.9, so error message should be updated. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-10-18 10:30:05 +08:00
Wenkai Yin(尹文开)
97ddff2ac8
Merge pull request #9434 from heww/clair-adapter 
build(clair): internal clair adapter when install with clair
 2019-10-17 16:06:10 +08:00
He Weiwei
8964a8697a build(clair): internal clair adapter when install with clair 
Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2019-10-17 12:00:51 +08:00
wang yan
66e9278fef add npm registry when to build offline package in drone CI 
Signed-off-by: wang yan <wangyan@vmware.com>
 2019-10-16 11:59:42 +08:00
Danfeng Liu (c)
848002df83 Fix an error in prepary.py in Jenkins upgrade pipeline, which is a 'if' position error in project metadata population. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-10-14 18:11:17 +08:00
Steven Zou
a86afd6ebc Merge branch 'master' into feature/pluggable_scanner_s3_merge 2019-10-12 15:18:06 +08:00
Wang Yan
454a427806
Merge pull request #9239 from danfengliu/project-metadata-verification-in-upgrade-verify-script 
Add project meta data verifcation In nightly migrate pipeline
 2019-10-11 14:05:33 +08:00
Steven Zou
58afd8e14b [stage3] support pluggable scanner 
- implement scan controller
- add scan resource and update role bindings
- update registration model and related interfaces

Signed-off-by: Steven Zou <szou@vmware.com>

- implement scan API to do scan/get report/get log
- update repository rest API to produce scan report summary
- update scan job hook handler
- update some UT cases

- update robot account making content
- hidden credential in the job log

Commnet scan related API test cases which will be re-activate later
fix #8985

fix the issues found by codacy

Signed-off-by: Steven Zou <szou@vmware.com>
 2019-10-11 12:53:02 +08:00
Danfeng Liu (c)
96a271f388 In nightly migrate pipeline, after migration, should check all the data which were populated, for now, project meta data were populated, but were not been verified, so I add these verification in this PR. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-10-11 10:28:02 +08:00
danfengliu
ac0d3c991a Add nightly test case of 'Retag should be forbidden when system configuration read-only mode was set'. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-10-10 17:13:19 +08:00
danfengliu
feeb6fb2d8 1. Nightly test case failed due to more vulnerbility CVE IDs in image redis, so add 2 new CVE IDs in CVE Whitelist test cases. 2. A Keyword parameter error was fixed in this PR. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-10-02 16:43:50 +08:00
danfengliu
f6759a0353
Merge pull request #9289 from danfengliu/add-cve-for-redis 
Add a new CVE ID  for image redis in nightly CVE system and project level whitelist tests
 2019-09-27 22:05:25 +08:00
danfengliu
0ff1ef8766
Merge pull request #9225 from danfengliu/add-retry-for-get-project-Quotas 
Add a keyword 'Retry Keyword When Return Value Mismatch'
 2019-09-27 17:23:38 +08:00
danfengliu
2298b96170 In nightly CVE whitelist tests, there be a new CVE occured in image redis, so add this for test verifcation. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-09-27 17:20:06 +08:00
He Weiwei
4ce72e37c4 fix(robot): robot account improvement for policies 
Signed-off-by: He Weiwei <hweiwei@vmware.com>
 2019-09-27 03:07:58 +00:00
Danfeng Liu (c)
20dc245631 In nightly helm pipeline, test case 'Project Quotas Control Under GC' failed, it should be timing issue that the valuse in UI is not ready, so I add a keyword 'Retry Keyword When Return Value Mismatch' to retry value getting action. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-09-25 17:02:05 +08:00
danfengliu
1157f129b4 After angular upgrade, in DB.robot, 4 test cases failed at create-a-new-user, the reason is that no sleep between input or click action, some blank was not inputed, so I add retry keyword for those actions. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-09-24 10:55:38 +08:00
danfengliu
7844ca0a2f
Merge pull request #9214 from danfengliu/add-nightly-test-case-of-retag-under-readonly-mode 
Add id for system configuration repo-readonly-checkbox in UI code
 2019-09-24 10:43:55 +08:00
Danfeng Liu (c)
3c8db37616 Add id for system configuration repo-readonly-checkbox in UI code, and add element locator in robot case. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-09-23 21:55:27 +08:00
danfengliu
cb5a145f27
Merge pull request #9212 from danfengliu/upgrade-preparev17-for-new-migrate-jenkins-pipeline-add-more-test-data 
commented 2 lines to remove Vulnerability scan all data verification
 2019-09-23 19:00:19 +08:00
danfengliu
7144f23857
Merge pull request #9204 from danfengliu/add-id-for-sign-up-btn 
Modify sign-up button xpath from relative html path to id
 2019-09-23 18:00:51 +08:00
Danfeng Liu (c)
6e4331fb92 In this PR right now, I commented 2 lines to remove a verification, it's because that Vulnerability data is not consistent when migrate harbor from 1.7 to 1.9, I've filed an issue to follow it, once it's fixed, these 2 commented lines will be come back. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-09-23 16:14:01 +08:00
Danfeng Liu (c)
cca1fab069 Modify sign-up button xpath from relative html path to id, and modify script. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-09-23 15:40:27 +08:00
Ziming
df625f4ef9
Merge pull request #9177 from bitsf/fix_tag_retention_test 
adjust wait job timeout in test case
 2019-09-23 14:47:05 +08:00
Danfeng Liu (c)
9a147f0999 In nightly test, keyword <Create An New Project> failed after angular upgrade, the OK button in create new project page was clicked, but it's not effective, so I add a retry for OK button click, if the button was not disappeared, script will be clicked again. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-09-20 16:22:10 +08:00
Ziming Zhang
afe81a8b3b adjust wait job timeout 
Change-Id: I8f32f814158d4a7418c39edb7a781879db17a4d7
Signed-off-by: Ziming Zhang <zziming@vmware.com>
 2019-09-20 16:18:03 +08:00
Danfeng Liu (c)
9e05e6dc74 After angula upraded, all migrate pipelines failed at system setting project creation verification. Keyword of Page Should Contain is not working anymore in new UI, so I choosen a new more precise way of checking the select element value of 'everyone' 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-09-20 14:55:53 +08:00
Danfeng Liu (c)
5d1913842c Script test case for project quotas, there will be 2 or 3 test cases in this PR, like project quota edit, prject quota functionality. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-09-18 17:55:25 +08:00
jwangyangls
6dd2ae90a0
Merge pull request #9011 from jwangyangls/upgrade_clarity-2.1 
Upgrade angular from 7.1.3 to 8.2.0 and clarity from 1.0 to 2.2
 2019-09-18 10:45:40 +08:00
Yogi_Wang
a7c7a8e675 Upgrade angualr from 7.1.3 to 8.2.0 and clarity from 1.0 to 2.2 
Signed-off-by: Yogi_Wang <yawang@vmware.com>

Signed-off-by: Meina Zhou <meinaz@vmware.com>
Signed-off-by: sshijun <sshijun@vmware.com>
 2019-09-18 10:12:20 +08:00
Wang Yan
6b5fd36bb3 add e2e test case for project quota 
1. Create a new user(UA);
2. Create a new private project(PA) by user(UA);
3. Add user(UA) as a member of project(PA) with project-admin role;
4. Push an image to project(PA) by user(UA), then check the project quota usage;
5. Check quota change
6. Delete image, the quota should be changed to 0.

Signed-off-by: wang yan <wangyan@vmware.com>
 2019-09-15 22:16:11 +08:00
Meina Zhou
70961ca02c upgrade node js version in ci and split the job to run frontend ut 
Signed-off-by: Meina Zhou <meinaz@vmware.com>
 2019-09-11 14:55:31 +08:00
Danfeng Liu (c)
ca8590c878 Replace CVE sample image from other to redis in union, redis is stable in relative, so test result will be stable relatively 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-09-09 18:36:07 +08:00
jwangyangls
f200125abb
Merge pull request #8980 from danfengliu/replace-image-for-ECR-test 
Replace image from tomcat to alpine for small size
 2019-09-06 21:02:45 +08:00
Ziming Zhang
722e45b20b add swagger for tag retention 
Signed-off-by: Ziming Zhang <zziming@vmware.com>
Change-Id: I0f3ed8085e231868de74c273ba85946826181d5b
 2019-09-06 17:27:20 +08:00
Danfeng Liu (c)
13af86dd85 Replace image from tomcat to alpine for small size, then it will not take a long time for replication. 
Signed-off-by: Danfeng Liu (c) <danfengl@vmware.com>
 2019-09-06 17:26:47 +08:00
danfengliu
8539ce7b77 Add CVE whitelist project level API test into travis tests. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-09-05 18:02:53 +08:00
danfengliu
8503957eac 1.Add CVE white list API test into API_DB.robot;2.Random data for prject name should use lower case %m%s;3.Replace from harbor to self. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-09-04 15:50:09 +08:00
danfengliu
5c8890bc6d Replace image from httpd to haproxy:1.5 to make sure serverity is stable for test. 
Signed-off-by: danfengliu <danfengl@vmware.com>
 2019-09-03 14:04:59 +08:00