mirror of
https://github.com/goharbor/harbor.git
synced 2024-09-09 20:48:08 +02:00
7fb9dbd0fa
1. Fix E2E quotas issue, push the same image but with different name; 2. Add checkpoint for robot account test; 3. Upgraded docker and containerd in E2E image; 4. Package base image sample(busybox) into E2E image, so in E2E container, all local docker images can be cleaned up, once base image is needed for building image, it can be loaded locally; 5. Adapt OIDC service of supporting LDAP user, and add OIDC group user test; 6. Restart docker deamon before content trust test, both in API and UI test; 7. Add retry for keyword "Add A Tag Immutability Rule"; 8. Fix tag retention test issue, missing click angle icon, and enhance checkpoint of dry run and real run; 9. Fix schedule test issue for wrong cron string; 10. Disable quotas verification, it's not stable for script defect; Signed-off-by: danfengliu <danfengl@vmware.com>
120 lines
5.5 KiB
Plaintext
120 lines
5.5 KiB
Plaintext
*** Settings ***
|
|
Documentation Harbor BATs
|
|
Resource ../../resources/Util.robot
|
|
Default Tags Nightly
|
|
|
|
*** Variables ***
|
|
${HARBOR_URL} https://${ip}
|
|
${HARBOR_ADMIN} admin
|
|
|
|
*** Test Cases ***
|
|
Test Case - Upgrade Verify
|
|
[Tags] 1.8-latest
|
|
${data}= Load Json From File ${CURDIR}${/}data.json
|
|
Run Keyword Verify User ${data}
|
|
Run Keyword Verify Project ${data}
|
|
Run Keyword Verify Project Label ${data}
|
|
Run Keyword Verify Project Metadata ${data}
|
|
Run Keyword Verify Member Exist ${data}
|
|
Run Keyword Verify Robot Account Exist ${data}
|
|
Run Keyword Verify User System Admin Role ${data}
|
|
Run Keyword Verify Endpoint ${data}
|
|
Run Keyword Verify Replicationrule ${data}
|
|
Run Keyword Verify System Setting ${data}
|
|
Run Keyword Verify Image Tag ${data}
|
|
|
|
Test Case - Upgrade Verify
|
|
[Tags] 1.9-latest
|
|
${data}= Load Json From File ${CURDIR}${/}data.json
|
|
Run Keyword Verify User ${data}
|
|
Run Keyword Verify Project ${data}
|
|
Run Keyword Verify Project Label ${data}
|
|
Run Keyword Verify Project Metadata ${data}
|
|
Run Keyword Verify Member Exist ${data}
|
|
Run Keyword Verify Robot Account Exist ${data}
|
|
Run Keyword Verify Project-level Allowlist ${data}
|
|
Run Keyword Verify Webhook ${data}
|
|
Run Keyword Verify Tag Retention Rule ${data}
|
|
Run Keyword Verify User System Admin Role ${data}
|
|
Run Keyword Verify Endpoint ${data}
|
|
Run Keyword Verify Replicationrule ${data}
|
|
Run Keyword Verify Interrogation Services ${data}
|
|
Run Keyword Verify System Setting ${data}
|
|
Run Keyword Verify System Setting Allowlist ${data}
|
|
Run Keyword Verify Image Tag ${data}
|
|
Run Keyword Verify Trivy Is Default Scanner
|
|
|
|
Test Case - Upgrade Verify
|
|
[Tags] 1.10-latest
|
|
${data}= Load Json From File ${CURDIR}${/}data.json
|
|
Run Keyword Verify User ${data}
|
|
Run Keyword Verify Project ${data}
|
|
Run Keyword Verify Project Label ${data}
|
|
Run Keyword Verify Project Metadata ${data}
|
|
Run Keyword Verify Member Exist ${data}
|
|
Run Keyword Verify Robot Account Exist ${data}
|
|
Run Keyword Verify Project-level Allowlist ${data}
|
|
Run Keyword Verify Webhook ${data}
|
|
Run Keyword Verify Tag Retention Rule ${data}
|
|
Run Keyword Verify Tag Immutability Rule ${data}
|
|
Run Keyword Verify User System Admin Role ${data}
|
|
Run Keyword Verify Endpoint ${data}
|
|
Run Keyword Verify Replicationrule ${data}
|
|
Run Keyword Verify Interrogation Services ${data}
|
|
Run Keyword Verify System Setting ${data}
|
|
Run Keyword Verify System Setting Allowlist ${data}
|
|
Run Keyword Verify Image Tag ${data}
|
|
|
|
Test Case - Upgrade Verify
|
|
[Tags] 2.0-latest
|
|
${data}= Load Json From File ${CURDIR}${/}data.json
|
|
Run Keyword Verify User ${data}
|
|
Run Keyword Verify Project ${data}
|
|
Run Keyword Verify Project Metadata ${data} check_content_trust=${false}
|
|
#Run Keyword Verify Project Label ${data}
|
|
Run Keyword Verify Member Exist ${data}
|
|
#TODO in 2.2: Modify this case when new robot account feature is ready.
|
|
#Run Keyword Verify Robot Account Exist ${data}
|
|
Run Keyword Verify Project-level Allowlist ${data}
|
|
Run Keyword Verify Webhook For 2.0 ${data}
|
|
Run Keyword Verify Tag Retention Rule ${data}
|
|
Run Keyword Verify Tag Immutability Rule ${data}
|
|
Run Keyword Verify User System Admin Role ${data}
|
|
Run Keyword Verify Endpoint ${data}
|
|
Run Keyword Verify Replicationrule ${data}
|
|
Run Keyword Verify Interrogation Services ${data}
|
|
Run Keyword Verify System Setting ${data}
|
|
Run Keyword Verify System Setting Allowlist ${data}
|
|
Run Keyword Verify Image Tag ${data}
|
|
Run Keyword Verify Trivy Is Default Scanner
|
|
Run Keyword Verify Artifact Index ${data}
|
|
#Run Keyword Verify Quotas Display ${data}
|
|
|
|
Test Case - Upgrade Verify
|
|
[Tags] 2.1-latest
|
|
${data}= Load Json From File ${CURDIR}${/}data.json
|
|
Run Keyword Verify User ${data}
|
|
Run Keyword Verify Project ${data} verify_registry_name=${true}
|
|
Run Keyword Verify Project Metadata ${data} check_content_trust=${false} verify_registry_name=${true}
|
|
#Run Keyword Verify Project Label ${data} verify_registry_name=${true}
|
|
Run Keyword Verify Member Exist ${data} verify_registry_name=${true}
|
|
##TODO in 2.2: Modify this case when new robot account feature is ready.
|
|
#Run Keyword Verify Robot Account Exist ${data} verify_registry_name=${true}
|
|
Run Keyword Verify Project-level Allowlist ${data} verify_registry_name=${true}
|
|
Run Keyword Verify Webhook For 2.0 ${data} verify_registry_name=${true}
|
|
Run Keyword Verify Tag Retention Rule ${data} verify_registry_name=${true}
|
|
Run Keyword Verify Tag Immutability Rule ${data} verify_registry_name=${true}
|
|
Run Keyword Verify Image Tag ${data} verify_registry_name=${true}
|
|
Run Keyword Verify User System Admin Role ${data}
|
|
Run Keyword Verify Endpoint ${data}
|
|
Run Keyword Verify Replicationrule ${data}
|
|
Run Keyword Verify Interrogation Services ${data}
|
|
Run Keyword Verify System Setting ${data}
|
|
Run Keyword Verify System Setting Allowlist ${data}
|
|
Run Keyword Verify Trivy Is Default Scanner
|
|
Run Keyword Verify Artifact Index ${data}
|
|
Run Keyword Verify Proxy Cache Image Existence ${data}
|
|
Run Keyword Verify Distributions ${data}
|
|
Run Keyword Verify P2P Preheat Policy ${data}
|
|
#Run Keyword Verify Quotas Display ${data}
|