2018-11-21 05:19:28 +01:00
from __future__ import absolute_import
import unittest
2020-11-04 03:13:12 +01:00
from testutils import ADMIN_CLIENT , suppress_urllib3_warning
2018-11-21 05:19:28 +01:00
from testutils import harbor_server
from testutils import TEARDOWN
2020-02-25 03:40:29 +01:00
from library . artifact import Artifact
2018-11-21 05:19:28 +01:00
from library . project import Project
from library . user import User
from library . repository import Repository
2020-12-04 11:28:29 +01:00
from library . repository import push_self_build_image_to_project
2018-12-04 06:08:36 +01:00
from library . repository import pull_harbor_image
Upgrade docker and containerd
1. Fix E2E quotas issue, push the same image but with different name;
2. Add checkpoint for robot account test;
3. Upgraded docker and containerd in E2E image;
4. Package base image sample(busybox) into E2E image, so in E2E
container, all local docker images can be cleaned up, once base image is needed for
building image, it can be loaded locally;
5. Adapt OIDC service of supporting LDAP user, and add OIDC group user
test;
6. Restart docker deamon before content trust test, both in API and UI
test;
7. Add retry for keyword "Add A Tag Immutability Rule";
8. Fix tag retention test issue, missing click angle icon, and enhance
checkpoint of dry run and real run;
9. Fix schedule test issue for wrong cron string;
10. Disable quotas verification, it's not stable for script defect;
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-01-29 08:52:21 +01:00
from library . docker_api import docker_image_clean_all
2018-11-21 05:19:28 +01:00
class TestProjects ( unittest . TestCase ) :
2020-11-04 03:13:12 +01:00
@suppress_urllib3_warning
2018-11-21 05:19:28 +01:00
def setUp ( self ) :
2020-02-25 03:40:29 +01:00
self . project = Project ( )
self . user = User ( )
2020-03-16 03:13:28 +01:00
self . artifact = Artifact ( )
self . repo = Repository ( )
2018-11-21 05:19:28 +01:00
Upgrade docker and containerd
1. Fix E2E quotas issue, push the same image but with different name;
2. Add checkpoint for robot account test;
3. Upgraded docker and containerd in E2E image;
4. Package base image sample(busybox) into E2E image, so in E2E
container, all local docker images can be cleaned up, once base image is needed for
building image, it can be loaded locally;
5. Adapt OIDC service of supporting LDAP user, and add OIDC group user
test;
6. Restart docker deamon before content trust test, both in API and UI
test;
7. Add retry for keyword "Add A Tag Immutability Rule";
8. Fix tag retention test issue, missing click angle icon, and enhance
checkpoint of dry run and real run;
9. Fix schedule test issue for wrong cron string;
10. Disable quotas verification, it's not stable for script defect;
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-01-29 08:52:21 +01:00
@unittest.skipIf ( TEARDOWN == True , " Test data won ' t be erased. " )
2020-11-04 03:13:12 +01:00
def tearDown ( self ) :
2018-11-21 05:19:28 +01:00
#1. Delete repository(RA) by user(UA);
2021-01-16 12:34:43 +01:00
self . repo . delete_repository ( TestProjects . project_content_trust_name , TestProjects . repo_name . split ( ' / ' ) [ 1 ] , * * TestProjects . USER_CONTENT_TRUST_CLIENT )
2018-11-21 05:19:28 +01:00
#2. Delete project(PA);
self . project . delete_project ( TestProjects . project_content_trust_id , * * TestProjects . USER_CONTENT_TRUST_CLIENT )
#3. Delete user(UA);
self . user . delete_user ( TestProjects . user_content_trust_id , * * ADMIN_CLIENT )
def testProjectLevelPolicyContentTrust ( self ) :
"""
Test case :
Project Level Policy Content Trust
2018-12-04 05:26:12 +01:00
Test step and expected result :
2018-11-21 05:19:28 +01:00
1. Create a new user ( UA ) ;
2. Create a new project ( PA ) by user ( UA ) ;
3. Push a new image ( IA ) in project ( PA ) by admin ;
4. Image ( IA ) should exist ;
5. Pull image ( IA ) successfully ;
6. Enable content trust in project ( PA ) configuration ;
7. Pull image ( IA ) failed and the reason is " The image is not signed in Notary " .
Tear down :
1. Delete repository ( RA ) by user ( UA ) ;
2. Delete project ( PA ) ;
3. Delete user ( UA ) ;
"""
url = ADMIN_CLIENT [ " endpoint " ]
Upgrade docker and containerd
1. Fix E2E quotas issue, push the same image but with different name;
2. Add checkpoint for robot account test;
3. Upgraded docker and containerd in E2E image;
4. Package base image sample(busybox) into E2E image, so in E2E
container, all local docker images can be cleaned up, once base image is needed for
building image, it can be loaded locally;
5. Adapt OIDC service of supporting LDAP user, and add OIDC group user
test;
6. Restart docker deamon before content trust test, both in API and UI
test;
7. Add retry for keyword "Add A Tag Immutability Rule";
8. Fix tag retention test issue, missing click angle icon, and enhance
checkpoint of dry run and real run;
9. Fix schedule test issue for wrong cron string;
10. Disable quotas verification, it's not stable for script defect;
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-01-29 08:52:21 +01:00
image = " test_content_trust "
2018-11-21 05:19:28 +01:00
user_content_trust_password = " Aa123456 "
#1. Create a new user(UA);
2018-11-29 11:27:53 +01:00
TestProjects . user_content_trust_id , user_content_trust_name = self . user . create_user ( user_password = user_content_trust_password , * * ADMIN_CLIENT )
2018-11-21 05:19:28 +01:00
TestProjects . USER_CONTENT_TRUST_CLIENT = dict ( endpoint = url , username = user_content_trust_name , password = user_content_trust_password )
#2. Create a new project(PA) by user(UA);
2020-02-21 10:08:27 +01:00
TestProjects . project_content_trust_id , TestProjects . project_content_trust_name = self . project . create_project ( metadata = { " public " : " false " } , * * TestProjects . USER_CONTENT_TRUST_CLIENT )
2018-11-21 05:19:28 +01:00
#3. Push a new image(IA) in project(PA) by admin;
Upgrade docker and containerd
1. Fix E2E quotas issue, push the same image but with different name;
2. Add checkpoint for robot account test;
3. Upgraded docker and containerd in E2E image;
4. Package base image sample(busybox) into E2E image, so in E2E
container, all local docker images can be cleaned up, once base image is needed for
building image, it can be loaded locally;
5. Adapt OIDC service of supporting LDAP user, and add OIDC group user
test;
6. Restart docker deamon before content trust test, both in API and UI
test;
7. Add retry for keyword "Add A Tag Immutability Rule";
8. Fix tag retention test issue, missing click angle icon, and enhance
checkpoint of dry run and real run;
9. Fix schedule test issue for wrong cron string;
10. Disable quotas verification, it's not stable for script defect;
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-01-29 08:52:21 +01:00
TestProjects . repo_name , tag = push_self_build_image_to_project ( TestProjects . project_content_trust_name , harbor_server , ADMIN_CLIENT [ " username " ] , ADMIN_CLIENT [ " password " ] , image , " latest " )
2018-11-21 05:19:28 +01:00
#4. Image(IA) should exist;
2020-02-25 03:40:29 +01:00
artifact = self . artifact . get_reference_info ( TestProjects . project_content_trust_name , image , tag , * * TestProjects . USER_CONTENT_TRUST_CLIENT )
2020-11-03 08:32:13 +01:00
self . assertEqual ( artifact . tags [ 0 ] . name , tag )
2018-11-21 05:19:28 +01:00
Upgrade docker and containerd
1. Fix E2E quotas issue, push the same image but with different name;
2. Add checkpoint for robot account test;
3. Upgraded docker and containerd in E2E image;
4. Package base image sample(busybox) into E2E image, so in E2E
container, all local docker images can be cleaned up, once base image is needed for
building image, it can be loaded locally;
5. Adapt OIDC service of supporting LDAP user, and add OIDC group user
test;
6. Restart docker deamon before content trust test, both in API and UI
test;
7. Add retry for keyword "Add A Tag Immutability Rule";
8. Fix tag retention test issue, missing click angle icon, and enhance
checkpoint of dry run and real run;
9. Fix schedule test issue for wrong cron string;
10. Disable quotas verification, it's not stable for script defect;
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-01-29 08:52:21 +01:00
docker_image_clean_all ( )
2018-11-21 05:19:28 +01:00
#5. Pull image(IA) successfully;
Upgrade docker and containerd
1. Fix E2E quotas issue, push the same image but with different name;
2. Add checkpoint for robot account test;
3. Upgraded docker and containerd in E2E image;
4. Package base image sample(busybox) into E2E image, so in E2E
container, all local docker images can be cleaned up, once base image is needed for
building image, it can be loaded locally;
5. Adapt OIDC service of supporting LDAP user, and add OIDC group user
test;
6. Restart docker deamon before content trust test, both in API and UI
test;
7. Add retry for keyword "Add A Tag Immutability Rule";
8. Fix tag retention test issue, missing click angle icon, and enhance
checkpoint of dry run and real run;
9. Fix schedule test issue for wrong cron string;
10. Disable quotas verification, it's not stable for script defect;
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-01-29 08:52:21 +01:00
pull_harbor_image ( harbor_server , ADMIN_CLIENT [ " username " ] , ADMIN_CLIENT [ " password " ] , TestProjects . repo_name , tag )
2018-11-21 05:19:28 +01:00
Upgrade docker and containerd
1. Fix E2E quotas issue, push the same image but with different name;
2. Add checkpoint for robot account test;
3. Upgraded docker and containerd in E2E image;
4. Package base image sample(busybox) into E2E image, so in E2E
container, all local docker images can be cleaned up, once base image is needed for
building image, it can be loaded locally;
5. Adapt OIDC service of supporting LDAP user, and add OIDC group user
test;
6. Restart docker deamon before content trust test, both in API and UI
test;
7. Add retry for keyword "Add A Tag Immutability Rule";
8. Fix tag retention test issue, missing click angle icon, and enhance
checkpoint of dry run and real run;
9. Fix schedule test issue for wrong cron string;
10. Disable quotas verification, it's not stable for script defect;
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-01-29 08:52:21 +01:00
self . project . get_project ( TestProjects . project_content_trust_id )
2018-11-21 05:19:28 +01:00
#6. Enable content trust in project(PA) configuration;
self . project . update_project ( TestProjects . project_content_trust_id , metadata = { " enable_content_trust " : " true " } , * * TestProjects . USER_CONTENT_TRUST_CLIENT )
Upgrade docker and containerd
1. Fix E2E quotas issue, push the same image but with different name;
2. Add checkpoint for robot account test;
3. Upgraded docker and containerd in E2E image;
4. Package base image sample(busybox) into E2E image, so in E2E
container, all local docker images can be cleaned up, once base image is needed for
building image, it can be loaded locally;
5. Adapt OIDC service of supporting LDAP user, and add OIDC group user
test;
6. Restart docker deamon before content trust test, both in API and UI
test;
7. Add retry for keyword "Add A Tag Immutability Rule";
8. Fix tag retention test issue, missing click angle icon, and enhance
checkpoint of dry run and real run;
9. Fix schedule test issue for wrong cron string;
10. Disable quotas verification, it's not stable for script defect;
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-01-29 08:52:21 +01:00
self . project . get_project ( TestProjects . project_content_trust_id )
2018-11-21 05:19:28 +01:00
#7. Pull image(IA) failed and the reason is "The image is not signed in Notary".
Upgrade docker and containerd
1. Fix E2E quotas issue, push the same image but with different name;
2. Add checkpoint for robot account test;
3. Upgraded docker and containerd in E2E image;
4. Package base image sample(busybox) into E2E image, so in E2E
container, all local docker images can be cleaned up, once base image is needed for
building image, it can be loaded locally;
5. Adapt OIDC service of supporting LDAP user, and add OIDC group user
test;
6. Restart docker deamon before content trust test, both in API and UI
test;
7. Add retry for keyword "Add A Tag Immutability Rule";
8. Fix tag retention test issue, missing click angle icon, and enhance
checkpoint of dry run and real run;
9. Fix schedule test issue for wrong cron string;
10. Disable quotas verification, it's not stable for script defect;
Signed-off-by: danfengliu <danfengl@vmware.com>
2021-01-29 08:52:21 +01:00
docker_image_clean_all ( )
pull_harbor_image ( harbor_server , ADMIN_CLIENT [ " username " ] , ADMIN_CLIENT [ " password " ] , TestProjects . repo_name , tag , expected_error_message = " The image is not signed in Notary " )
2018-11-21 05:19:28 +01:00
if __name__ == ' __main__ ' :
unittest . main ( )