Wenkai Yin
294385c34d
Refactor the replication execution
...
1. Use the task manager to manage the underlying execution/task
2. Use the pkg/scheduler to schedule the periodical job
3. Apply the new program model
4. Migration the old data into the new data model
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-11-23 14:24:10 +08:00
danfengliu
1b127b16c5
Add API test scripts for tag immutability and scan signed image
...
1. Add 7 API python test scripts for tag immutability;
2. Swagger file has object struct defination issue on imuutability policy rule, because
this policy is in shared with retention rule, therefore, they should be unified to
the same type of rule;
3. Fixed a timeout issue of action keyword, waiting for a long period;
4. Add API test scripts for scan signed image.
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-11-03 10:10:06 +00:00
疯魔慕薇
2bab4a10db
Merge pull request #13393 from chlins/fix/p2p-preheat-instance-and-policy-post-no-location
...
fix(preheat): add location when create instance and policy
2020-10-31 23:48:41 +08:00
chlins
9887154a0a
fix(preheat): add location when create instance and policy
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2020-10-29 18:16:59 +08:00
chlins
1a0c2fe980
fix(preheat): disable preheat model bool type json omitempty option
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2020-10-28 17:54:11 +08:00
Tim Hobbs
c7e547e3d2
fix: Location Header in swagger api
...
* Add the Location Header to POST responses that use the common response
Without the header, you cannot know which object you just created.
Signed-off-by: Tim Hobbs <timothy.hobbs@ic-consult.com>
2020-09-12 14:36:50 +02:00
Tim Hobbs
4655334e02
fix: Location and Paging support in swagger api
...
Signed-off-by: Tim Hobbs <timothy.hobbs@ic-consult.com>
2020-09-06 21:06:38 +02:00
stonezdj(Daojun Zhang)
716625a769
Merge pull request #12793 from ywk253100/200816_disable_tag
...
Disable the tag creation for the artifact under a proxy cache project
2020-08-18 16:15:33 +08:00
chlins
4f95c4d067
fix(preheat): fix the swagger definition of preheat get log api
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2020-08-17 12:41:02 +08:00
Wenkai Yin
e9ce631aa3
Disable the tag creation for the artifact under a proxy cache project
...
Disable the tag creation for the artifact under a proxy cache project
Fixes #12713
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-08-16 22:02:30 +08:00
He Weiwei
f309896f2f
refactor(api): generate project apis by go-swagger
...
Signed-off-by: He Weiwei <hweiwei@vmware.com>
2020-08-15 16:10:57 +00:00
Wenkai Yin
b1ddb5e2cc
Implement the icon API to get the icon of artifact
...
Implement the icon API to get the icon of artifact
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-08-15 08:40:38 +08:00
He Weiwei
e473127343
fix(swagger): format the value of ResourceList as int64 ( #12767 )
...
Closes #12482
Signed-off-by: He Weiwei <hweiwei@vmware.com>
2020-08-13 14:07:53 +08:00
chlins
5c433c0875
fix(preheat): add precheck when delete instance
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2020-08-07 14:06:35 +08:00
疯魔慕薇
19234cdb46
Merge pull request #12673 from chlins/fix/preheat-execution-and-task-pagination
...
fix(preheat): add pagination for execution and task list api
2020-08-06 23:08:21 +08:00
chlins
302e4c6659
fix(preheat): add pagination for execution and task list api
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2020-08-06 16:59:38 +08:00
Steven Zou
f7bb6dd233
Merge pull request #12665 from chlins/fix/preheat-list-providers-under-project
...
fix(preheat): provider more info about p2p provider instance
2020-08-06 16:57:21 +08:00
chlins
89972f766f
fix(preheat): provider more info about p2p provider instance
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2020-08-05 17:23:43 +08:00
He Weiwei
0ae8133a60
Merge pull request #12656 from chlins/fix/v2.0-swagger-errors-definition
...
fix(swagger): fix the definition of errors
2020-08-05 11:01:01 +08:00
chlins
487e8b43ab
fix(swagger): fix the definition of errors
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2020-08-04 12:21:50 +08:00
chlins
b008dffe70
fix(preheat): fix preheat task log display
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2020-08-03 09:45:18 +08:00
Wang Yan
9ce29c9dc8
update time format of audit log ( #12629 )
...
fixes #11522
use the format: date-time as the format of audit op_time, then it could be rendered by FF and Chrome.
Signed-off-by: wang yan <wangyan@vmware.com>
2020-07-30 17:29:25 +08:00
stonezdj(Daojun Zhang)
5b1b94f25c
Merge pull request #12512 from ywk253100/200717_summary
...
Include the registry info in the project summary API for proxy cache project
2020-07-29 14:39:30 +08:00
Steven Zou
ee35e1ecc6
Merge pull request #12507 from chlins/fix/preheat-update-instance
...
fix(preheat): fix preheat handler PingInstance and UpdateInstance
2020-07-20 17:45:24 +08:00
chlins
78927af032
fix(preheat): fix preheat handler PingInstance and UpdateInstance
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2020-07-20 15:42:24 +08:00
Wenkai Yin
d7327d8d8e
Include the registry info in the project summary API for proxy cache project
...
Include the registry info in the project summary API for proxy cache project
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-07-17 16:14:45 +08:00
Wenkai Yin
54a1155140
Prevent copying artifact to a proxy cache project
...
Prevent copying artifact to a proxy cache project
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-07-17 15:24:18 +08:00
chlins
7322d0ac7c
feat(preheat): add list providers under project level handler
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2020-07-13 21:53:50 +08:00
chlins
08bd46e125
feat: add preheat execution api handler
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2020-07-13 13:14:08 +08:00
fanjiankong
080afbfe1b
Add preheat APIs, handlers.
...
1. Manual preheat.
2. Instance health check.
Signed-off-by: fanjiankong <fanjiankong@tencent.com>
2020-07-10 09:48:35 +08:00
Daniel Jiang
1637e6a588
Rename master role to maintainer
...
This commit rename the var name, text appearance, and swagger of "master" role
to "maintainer" role.
It only covers backend code.
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2020-07-08 09:20:07 +08:00
fanjiankong
3c1c799f0d
Get instance by name.
...
Signed-off-by: fanjiankong <fanjiankong@tencent.com>
2020-07-07 22:06:38 +08:00
chlins
9b2eaf1c07
fix: adjust p2p preheat policy swagger yaml definitions
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2020-07-07 18:25:23 +08:00
stonezdj(Daojun Zhang)
6f4e8150d5
Merge pull request #12383 from ywk253100/200702_registry_api
...
Suport filtering registries by type in listing registry API
2020-07-07 14:21:54 +08:00
Wenkai Yin
02690d1d04
Suport filtering registries by type in listing registry API
...
Suport filtering registries by type in listing registry API
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-07-07 10:30:46 +08:00
chlins
37a00912b7
feat: add p2p preheat swagger yaml and implement preheat api policy handler
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2020-07-06 21:05:22 +08:00
fanjiankong
a0c2d0ac9e
feat(preheat):add preheat api, controller and manager
...
- define instance's api
- define extension models for api
- implement preheat controller
- implement preheat manager
- most code are picked up from the original P2P feat branch
Signed-off-by: fanjiankong <fanjiankong@tencent.com>
2020-07-03 11:25:42 +08:00
AllForNothing
fff6f7529a
Replace all whitelist with allowlist
...
Signed-off-by: AllForNothing <sshijun@vmware.com>
2020-06-24 16:17:17 +08:00
Wenkai Yin
a79bb127b3
Update creating project API to support proxy cache project
...
Update creating project API to support proxy cache project
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-06-10 17:14:12 +08:00
He Weiwei
8458f980d0
fix(swagger): enable security in swagger.yaml
...
1. Enable `security` in the swagger.yaml.
2. Include `basic` auth in `security` to make the generated python
client by `swagger-codegen-cli` work with basic authorization.
3. Include `anonymous` auth in `security` to make APIs of v2.0 generated
by `goswagger` work with `security` middleware.
Closes #11771
Signed-off-by: He Weiwei <hweiwei@vmware.com>
2020-04-28 02:34:34 +00:00
Ziming Zhang
6dfe504325
fix(retention) add extras field to retention swagger
...
Signed-off-by: Ziming Zhang <zziming@vmware.com>
2020-04-26 14:29:11 +08:00
Wenkai Yin
208c6f6223
Add version API to swagger
...
1. Add version API to swagger
2. Update the description for query
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-04-09 11:03:42 +08:00
Wenkai Yin
7188e01569
Update APIs to only accept encoded repository name that contains slash
...
Update APIs to only accept encoded repository name that contains slash
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-04-07 20:57:50 +08:00
Wenkai Yin(尹文开)
88ae9c458c
Update tags related APIs ( #11435 )
...
* Update tags related APIs
1. Remove API for listing tags of repository
2. Add API for listing tags of artifact
3. Support filter artifact by tag name
Signed-off-by: Wenkai Yin <yinw@vmware.com>
* [OCI] modify artifact tag name check
1. switch api get tag list
2. modify artifact tag name check
Signed-off-by: Yogi_Wang <yawang@vmware.com>
Co-authored-by: Yogi_Wang <yawang@vmware.com>
2020-04-07 16:28:51 +08:00
Wenkai Yin(尹文开)
5d55bd1d0c
Merge pull request #11463 from ywk253100/200407_copy
...
Update the logic of copy artifact
2020-04-07 14:36:27 +08:00
Wenkai Yin
9bfabff4d2
Update the logic of copy artifact
...
1. Copy artifact will not return 409 anymore.
2. Make sure the tags of source artifact exist in the target artifact
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-04-07 10:55:55 +08:00
He Weiwei
69ca7a0dae
refactor: cleanup unused code about scan
...
1. Cleanup unused code about clair.
2. Cleanup unused definitions in legacy_swagger.yaml about scan.
Signed-off-by: He Weiwei <hweiwei@vmware.com>
2020-04-06 17:34:25 +00:00
He Weiwei
80027c3b86
Merge pull request #11397 from ywk253100/200402_chart_api
...
Add a seperated swagger file for chart API
2020-04-07 00:05:49 +08:00
Wenkai Yin
8f8b4d5e8d
Add a seperated swagger file for chart API
...
Add a seperated swagger file for chart API as these APIs have no version
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-04-06 16:30:26 +08:00
He Weiwei
0a1730edb8
fix(swagger): make json as default response
...
Signed-off-by: He Weiwei <hweiwei@vmware.com>
2020-04-06 05:13:21 +00:00
Wenkai Yin(尹文开)
98759642b7
Add API to list tags under the specific repository ( #11336 )
...
Add API to list tags under the specific repository
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-03-29 12:19:54 +08:00
Wenkai Yin
dca06b6ede
Add "_self" suffix for repository API to avoid conflict
...
Add "_self" suffix for repository API to avoid conflict
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-03-20 17:08:08 +08:00
Wenkai Yin(尹文开)
32f226901f
Move the webhook event API definition to legacy_swagger.yaml ( #11127 )
...
The API definition is put on the wrong swagger file introduced by PR #11029 by mistake
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-03-19 14:24:29 +08:00
Wenkai Yin
b8b36d4eb3
Remove the useless definitions in lagacy swagger.yaml
...
Remove the useless definitions in lagacy swagger.yaml
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-03-18 21:04:39 +08:00
Wenkai Yin(尹文开)
c505c82d57
Merge pull request #11126 from ywk253100/200318_label_resource
...
Remove the API to listing the resources that added with the specific label
2020-03-18 20:58:28 +08:00
jwangyangls
1d435bc246
Merge pull request #11086 from danfengliu/add-api-test-of-add-addition
...
Modify api test for test step of add addition
2020-03-18 20:12:46 +08:00
Wenkai Yin
c92d9e4034
Remove the API to listing the resources that added with the specific label
...
As we introduce a new table to record the relationship between the artifacts and labels, the current way to list label's resources doesn't work anymore, and the API isn't needed by any features, remove it in 2.0
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-03-18 18:47:44 +08:00
Wenkai Yin(尹文开)
1f0c559a0f
Update the swagger ( #11040 )
...
Remove the other query string for listing repositories/artifacts and add some new TODO items
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-03-18 18:02:17 +08:00
danfengliu
77e9fc38c7
Modify api test for test step of add addition
...
Signed-off-by: danfengliu <danfengl@vmware.com>
2020-03-18 17:32:10 +08:00
Wang Yan
050967f95f
Use new query model to get audit logs ( #11113 )
...
* Use new query model to get audit logs
leverage the query builder to build query, remove the old style query string
Signed-off-by: wang yan <wangyan@vmware.com>
* Switch to new API for project log page
Signed-off-by: AllForNothing <sshijun@vmware.com>
Co-authored-by: AllForNothing <sshijun@vmware.com>
2020-03-18 13:46:49 +08:00
Wang Yan
ce2257dc22
update project logs api to v2.0 ( #11097 )
...
use audit log api to get project logs
Signed-off-by: wang yan <wangyan@vmware.com>
2020-03-17 11:58:43 +08:00
Wenkai Yin(尹文开)
89eeeb29ca
Change tag count to artifact count in search result ( #11068 )
...
Change tag count to artifact count in search result
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-03-16 14:28:59 +08:00
He Weiwei
12f16c8cec
feat(scan): support to scan image index ( #11001 )
...
Signed-off-by: He Weiwei <hweiwei@vmware.com>
2020-03-12 19:30:12 +08:00
Wenkai Yin
4ccc3da99b
Remove the "x-go-type" for artifact definition in swagger
...
Using "x-go-type" may cause the inconsistence between the swagger definition and the real data model
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-03-12 10:06:22 +08:00
Ted Guan
4ac31c6d46
Add API for query supported event types and notify types; Return policy name in last trigger info; Remove project_id unique constraint in table notification_policy ( #11029 )
...
Signed-off-by: guanxiatao <guanxiatao@corp.netease.com>
2020-03-11 18:06:58 +08:00
Wang Yan
f49994d81d
enable garbage colloection api test case ( #11000 )
...
Signed-off-by: wang yan <wangyan@vmware.com>
2020-03-11 11:19:29 +08:00
Wenkai Yin(尹文开)
307dbc6fba
Accept the pagination information in the separated query string ( #10991 )
...
Accept the pagination information in the separated query string
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-03-09 22:19:42 +08:00
Wenkai Yin
b14762ee17
Add support for querying artifact by labels and tags
...
Add support for querying artifact by labels and tags
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-03-07 11:32:15 +08:00
Wenkai Yin(尹文开)
63cf1041f7
Merge pull request #10941 from ywk253100/200304_query_label
...
Implement query string builder
2020-03-06 13:18:10 +08:00
Wenkai Yin
8abb630b4c
Implement query string builder
...
This commit defines the API query string format and provides the builders to build query string to query model
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-03-05 17:46:11 +08:00
wang yan
df237a5b17
add audit logs API
...
1, add API entry for get audit logs
2. add audit log manager to hanlder CRUD
Use the new format of audit log to cover differernt resource, artifact/tag/repostory/project
Signed-off-by: wang yan <wangyan@vmware.com>
2020-03-05 11:40:51 +08:00
Wenkai Yin
e3bbcb66d1
Set the "Link" and "location" header
...
Set the "Link" and "location" header
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-02-28 17:09:18 +08:00
Wenkai Yin
4deb7dc239
Fix bug of swagger for repository API
...
Fix bug of swagger for repository API
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-02-25 16:23:20 +08:00
Wenkai Yin(尹文开)
5f9c976e95
Merge pull request #10837 from heww/scan-api
...
feat(scan): add scan API in v2.0
2020-02-25 14:45:19 +08:00
He Weiwei
55a21cd444
feat(scan): add scan API in v2.0
...
Signed-off-by: He Weiwei <hweiwei@vmware.com>
2020-02-25 06:01:37 +00:00
Wenkai Yin
bb3ff0d752
Implement the API to get the specified repository
...
Implement the API to get the specified repository
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-02-25 12:02:50 +08:00
Wang Yan
948d45604c
Revise the GC job flow,
...
1, set harbor to readonly
2, select the candidate artifacts from Harbor DB.
3, call registry API(--delete-untagged=false) to delete manifest bases on the results of #2
4, clean keys of redis DB of registry, clean artifact trash and untagged from DB.
5, roll back readonly.
Signed-off-by: wang yan <wangyan@vmware.com>
2020-02-24 18:29:55 +08:00
Wenkai Yin
bd204464f3
Remove dead code
...
Remove dead code
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-02-23 17:11:46 +08:00
He Weiwei
f36152a560
feat(vulnerability): assemble vulnerabilities info for artifact ( #10800 )
...
1. Assemble scan overview to artifact when scanner enabled in the
project of the artifact.
2. Set addition link for vulnerabilities to artifact when scanner
enabled in the project of the artifact.
Signed-off-by: He Weiwei <hweiwei@vmware.com>
2020-02-22 13:29:58 +08:00
Wenkai Yin
c4d4850845
Implement copy artifact API
...
Copy artifact into the repository from the specified artifact
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-02-20 16:59:35 +08:00
Wenkai Yin
1db0077096
Implement delete/update repository API
...
Implement delete/update repository API
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-02-20 08:39:26 +08:00
Wang Yan
384086c5ad
update the enum value for chart on api get the addition ( #10752 )
...
Signed-off-by: wang yan <wangyan@vmware.com>
2020-02-19 00:28:39 +08:00
Wenkai Yin
c8c944c6e8
Move the scan overview populating logic to API handler
...
Move the scan overview populating logic to API handler to avoid importing cycle
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-02-18 13:34:08 +08:00
Wenkai Yin(尹文开)
560dd8ce7b
Merge pull request #10745 from reasonerjt/artifact-signature-populate-v2
...
Artifact signature populate
2020-02-18 13:24:55 +08:00
Wenkai Yin(尹文开)
341cb88cba
Merge pull request #10727 from ywk253100/200214_bump_up_legacy_api_version
...
Bump up legacy api version to v2.0
2020-02-18 10:37:25 +08:00
Daniel Jiang
5a6e9331fd
Artifact signature populate ( #7 )
...
* Populate signature status in artifact API
This Commit add signature status into response of list artifact API.
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2020-02-18 01:42:56 +08:00
Wenkai Yin(尹文开)
d7903fcf1b
Merge pull request #10682 from ywk253100/200126_label
...
Support add/remove label to/from artifact
2020-02-17 11:33:45 +08:00
Wenkai Yin
94787ea60d
Bump up the version of legacy APIs to v2.0
...
Bump up the version of legacy APIs to v2.0
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-02-14 13:16:30 +08:00
AllForNothing
036ae18b25
Improve swagger.yaml
...
Signed-off-by: AllForNothing <sshijun@vmware.com>
2020-02-14 11:43:15 +08:00
Wenkai Yin
93731eeb2e
Support add/remove label to/from artifact
...
This commit add supporting for adding/removing label to/from artifacts and populates labels when listing artifacts
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-02-13 10:46:23 +08:00
Wang Yan
e68b474dbc
Merge pull request #10581 from ywk253100/100123_list_artifact
...
Add query string to listing artifact API to support specify only show the tagged artifacts
2020-02-10 18:12:06 +08:00
Wang Yan
65dc54b059
Merge pull request #10626 from ywk253100/200125_handle_error
...
Unify the method/style to handle error in handler/middleware
2020-02-10 17:47:12 +08:00
Wenkai Yin
0373e08e58
Add query string to listing artifact API to support specify only show the tagged artifacts
...
Specify the query string "tags=NOT_NULL" to the listing artifact API to only return the tagged artifacts
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-02-10 14:53:51 +08:00
Wenkai Yin
af4dd142bc
Unify the method/style to handle error in handler/middleware
...
This commit provides a "SendError" method to unify the way to handle error in handlers/middlewares
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-02-08 07:37:00 +08:00
Wenkai Yin
0f6057a22c
Implement get addition API for image
...
This commit implements the API to get build history of image with manifest version 2 and populates the addition links when listing/getting the artifact
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-02-07 20:21:38 +08:00
Wang Yan
6bad9f62ba
Merge pull request #10662 from ywk253100/200206_delete_repo
...
Implement repository deletion API
2020-02-07 17:51:03 +08:00
Wang Yan
5679c174c6
Merge pull request #10643 from ywk253100/200204_auth
...
Add permission check for artifact related APIs
2020-02-07 11:25:37 +08:00
Wenkai Yin
c267aaa474
Implement repository deletion API
...
Implement repository deletion API based on the new design
Signed-off-by: Wenkai Yin <yinw@vmware.com>
2020-02-07 09:36:35 +08:00
Wang Yan
72f9e02dd9
Merge pull request #10628 from wy65701436/af-immu
...
set the immutable status on getting/listting tag
2020-02-05 21:03:29 +08:00
wang yan
596a6261ca
set the immutable status on getting/listting tag
...
Signed-off-by: wang yan <wangyan@vmware.com>
2020-02-05 16:24:13 +08:00