Skip to content

Commit

Permalink
Merge pull request #50 from thin-edge/test-use-full-image-name
Browse files Browse the repository at this point in the history 
tests: use full image names in version field
  • Loading branch information
@reubenmiller
reubenmiller authored Nov 29, 2024
2 parents 47b65d2 + da197d8 commit a738969
Show file tree
Hide file tree
Showing 2 changed files with 8 additions and 8 deletions.
8 changes: 4 additions & 4 deletions tests/main/self-update-compat.robot
View file
Original file line number Diff line number Diff line change
Expand Up @@ -10,12 +10,12 @@ Test Tags self-update
*** Test Cases ***
Update From Legacy Versions
[Template] Upgrade From Base Image
ghcr.io/thin-edge/tedge-container-bundle:20241126.1855 tedge-container-bundle:20241126.1855
ghcr.io/thin-edge/tedge-container-bundle:20241126.1855


*** Keywords ***
Upgrade From Base Image
[Arguments] ${IMAGE} ${SOFTWARE_VERSION}
[Arguments] ${IMAGE}
# pre-condition
Setup Device image=${IMAGE}

Expand All @@ -26,11 +26,11 @@ Upgrade From Base Image
Skip If '${major_version}' == '4' Legacy images didn't support podman 4.x

Device Should Have Installed Software
... {"name": "tedge", "version": "${SOFTWARE_VERSION}", "softwareType": "self"} timeout=10
... {"name": "tedge", "version": "${IMAGE}", "softwareType": "self"} timeout=10

${operation}= Cumulocity.Install Software
... {"name": "tedge", "version": "ghcr.io/thin-edge/tedge-container-bundle:99.99.1", "softwareType": "self"}

Cumulocity.Operation Should Be SUCCESSFUL ${operation} timeout=120
Device Should Have Installed Software
... {"name": "tedge", "version": "tedge-container-bundle:99.99.1", "softwareType": "self"}
... {"name": "tedge", "version": "ghcr.io/thin-edge/tedge-container-bundle:99.99.1", "softwareType": "self"}
8 changes: 4 additions & 4 deletions tests/main/self-update.robot
View file
Original file line number Diff line number Diff line change
Expand Up @@ -35,23 +35,23 @@ Self update should only update if there is a new image
Self update using software update operation
# pre-condition
Device Should Have Installed Software
... {"name": "tedge", "version": "tedge-container-bundle:99.99.1", "softwareType": "self"} timeout=10
... {"name": "tedge", "version": "ghcr.io/thin-edge/tedge-container-bundle:99.99.1", "softwareType": "self"} timeout=10

${operation}= Cumulocity.Install Software
... {"name": "tedge", "version": "ghcr.io/thin-edge/tedge-container-bundle:99.99.2", "softwareType": "self"}

Cumulocity.Operation Should Be SUCCESSFUL ${operation} timeout=120
Device Should Have Installed Software
... {"name": "tedge", "version": "tedge-container-bundle:99.99.2", "softwareType": "self"}
... {"name": "tedge", "version": "ghcr.io/thin-edge/tedge-container-bundle:99.99.2", "softwareType": "self"}

Rollback when trying to install a non-tedge based image
# pre-condition
Device Should Have Installed Software
... {"name": "tedge", "version": "tedge-container-bundle:99.99.1", "softwareType": "self"} timeout=10
... {"name": "tedge", "version": "ghcr.io/thin-edge/tedge-container-bundle:99.99.1", "softwareType": "self"} timeout=10

${operation}= Cumulocity.Install Software
... {"name": "tedge", "version": "docker.io/library/alpine:latest", "softwareType": "self"}

Cumulocity.Operation Should Be FAILED ${operation} timeout=120
Device Should Have Installed Software
... {"name": "tedge", "version": "tedge-container-bundle:99.99.1", "softwareType": "self"}
... {"name": "tedge", "version": "ghcr.io/thin-edge/tedge-container-bundle:99.99.1", "softwareType": "self"}

7 comments on commit a738969

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Robot Results

✅ Passed ❌ Failed ⏭️ Skipped Total Pass % ⏱️ Duration
16 0 2 16 100 3m46.860706s

Passed Tests

Name ⏱️ Duration Suite
Grace period to allow container to startup 5.054 s Operations
Service is up 0.152 s Operations
Get Logfile Request 2.359 s Operations
Get Configuration File 4.701 s Operations
Execute Shell Command 2.368 s Operations
Install application using docker compose 17.475 s Operations
Get Container Logs 2.377 s Operations
Get Container Logs without explicit container name 2.367 s Operations
Get Container Logs For Non-existent container 2.376 s Operations
Trigger self update via local command 24.322 s Self-Update
Self update should only update if there is a new image 19.928 s Self-Update
Self update using software update operation 100.371 s Self-Update
Rollback when trying to install a non-tedge based image 20.238 s Self-Update
Cloud Connection is Online 0.152 s Telemetry
Service status 0.249 s Telemetry
Sends measurements 2.479 s Telemetry

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Robot Results

✅ Passed ❌ Failed ⏭️ Skipped Total Pass % ⏱️ Duration
16 0 2 16 100 3m54.14458s

Passed Tests

Name ⏱️ Duration Suite
Grace period to allow container to startup 5.049 s Operations
Service is up 0.160 s Operations
Get Logfile Request 2.380 s Operations
Get Configuration File 4.745 s Operations
Execute Shell Command 2.402 s Operations
Install application using docker compose 15.467 s Operations
Get Container Logs 2.398 s Operations
Get Container Logs without explicit container name 2.407 s Operations
Get Container Logs For Non-existent container 2.393 s Operations
Trigger self update via local command 24.201 s Self-Update
Self update should only update if there is a new image 28.215 s Self-Update
Self update using software update operation 99.556 s Self-Update
Rollback when trying to install a non-tedge based image 20.338 s Self-Update
Cloud Connection is Online 0.180 s Telemetry
Service status 0.297 s Telemetry
Sends measurements 2.572 s Telemetry

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Robot Results

✅ Passed ❌ Failed ⏭️ Skipped Total Pass % ⏱️ Duration
17 0 1 17 100 5m42.617237s

Passed Tests

Name ⏱️ Duration Suite
Grace period to allow container to startup 5.043 s Operations
Service is up 0.145 s Operations
Get Logfile Request 2.343 s Operations
Get Configuration File 4.702 s Operations
Execute Shell Command 2.363 s Operations
Install application using docker compose 17.401 s Operations
Get Container Logs 2.358 s Operations
Get Container Logs without explicit container name 2.351 s Operations
Get Container Logs For Non-existent container 2.351 s Operations
Update From Legacy Versions 127.912 s Self-Update-Compat
Trigger self update via local command 24.801 s Self-Update
Self update should only update if there is a new image 20.347 s Self-Update
Self update using software update operation 102.719 s Self-Update
Rollback when trying to install a non-tedge based image 24.878 s Self-Update
Cloud Connection is Online 0.149 s Telemetry
Service status 0.252 s Telemetry
Sends measurements 2.453 s Telemetry

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Robot Results

✅ Passed ❌ Failed ⏭️ Skipped Total Pass % ⏱️ Duration
17 0 1 17 100 5m49.382543s

Passed Tests

Name ⏱️ Duration Suite
Grace period to allow container to startup 5.046 s Operations
Service is up 0.155 s Operations
Get Logfile Request 2.354 s Operations
Get Configuration File 4.696 s Operations
Execute Shell Command 2.403 s Operations
Install application using docker compose 17.452 s Operations
Get Container Logs 2.379 s Operations
Get Container Logs without explicit container name 2.370 s Operations
Get Container Logs For Non-existent container 2.827 s Operations
Update From Legacy Versions 130.027 s Self-Update-Compat
Trigger self update via local command 25.053 s Self-Update
Self update should only update if there is a new image 20.601 s Self-Update
Self update using software update operation 103.438 s Self-Update
Rollback when trying to install a non-tedge based image 27.173 s Self-Update
Cloud Connection is Online 0.175 s Telemetry
Service status 0.686 s Telemetry
Sends measurements 2.498 s Telemetry

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Robot Results

✅ Passed ❌ Failed ⏭️ Skipped Total Pass % ⏱️ Duration
17 0 1 17 100 5m48.660859s

Passed Tests

Name ⏱️ Duration Suite
Grace period to allow container to startup 5.045 s Operations
Service is up 0.152 s Operations
Get Logfile Request 2.357 s Operations
Get Configuration File 4.699 s Operations
Execute Shell Command 2.381 s Operations
Install application using docker compose 15.359 s Operations
Get Container Logs 2.374 s Operations
Get Container Logs without explicit container name 2.382 s Operations
Get Container Logs For Non-existent container 2.370 s Operations
Update From Legacy Versions 131.166 s Self-Update-Compat
Trigger self update via local command 25.359 s Self-Update
Self update should only update if there is a new image 21.041 s Self-Update
Self update using software update operation 103.419 s Self-Update
Rollback when trying to install a non-tedge based image 27.581 s Self-Update
Cloud Connection is Online 0.170 s Telemetry
Service status 0.286 s Telemetry
Sends measurements 2.476 s Telemetry

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Robot Results

✅ Passed ❌ Failed ⏭️ Skipped Total Pass % ⏱️ Duration
17 0 1 17 100 5m56.420337s

Passed Tests

Name ⏱️ Duration Suite
Grace period to allow container to startup 5.038 s Operations
Service is up 0.215 s Operations
Get Logfile Request 2.521 s Operations
Get Configuration File 5.057 s Operations
Execute Shell Command 2.538 s Operations
Install application using docker compose 18.210 s Operations
Get Container Logs 2.573 s Operations
Get Container Logs without explicit container name 2.547 s Operations
Get Container Logs For Non-existent container 2.970 s Operations
Update From Legacy Versions 131.735 s Self-Update-Compat
Trigger self update via local command 25.902 s Self-Update
Self update should only update if there is a new image 21.316 s Self-Update
Self update using software update operation 104.034 s Self-Update
Rollback when trying to install a non-tedge based image 28.404 s Self-Update
Cloud Connection is Online 0.221 s Telemetry
Service status 0.380 s Telemetry
Sends measurements 2.715 s Telemetry

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Robot Results

✅ Passed ❌ Failed ⏭️ Skipped Total Pass % ⏱️ Duration
17 0 1 17 100 5m51.622491999s

Passed Tests

Name ⏱️ Duration Suite
Grace period to allow container to startup 5.042 s Operations
Service is up 0.280 s Operations
Get Logfile Request 2.383 s Operations
Get Configuration File 4.749 s Operations
Execute Shell Command 2.395 s Operations
Install application using docker compose 15.473 s Operations
Get Container Logs 2.410 s Operations
Get Container Logs without explicit container name 2.500 s Operations
Get Container Logs For Non-existent container 2.396 s Operations
Update From Legacy Versions 134.061 s Self-Update-Compat
Trigger self update via local command 26.044 s Self-Update
Self update should only update if there is a new image 21.668 s Self-Update
Self update using software update operation 106.226 s Self-Update
Rollback when trying to install a non-tedge based image 22.956 s Self-Update
Cloud Connection is Online 0.170 s Telemetry
Service status 0.291 s Telemetry
Sends measurements 2.535 s Telemetry

Please sign in to comment.