e2e-tests: Add end-to-end test script and docker compose app #359
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
detsch
force-pushed
the
detsch-e2e-test
branch
2 times, most recently
from
8872c6a
to
d9c00f6
Compare
detsch
force-pushed
the
detsch-e2e-test
branch
3 times, most recently
from
60a4681
to
939bd5a
Compare
mike-sul
reviewed
Oct 16, 2024
Signed-off-by: Andre Detsch <[email protected]>
detsch
force-pushed
the
detsch-e2e-test
branch
from
939bd5a
to
1705a02
Compare
detsch
changed the title
detsch
force-pushed
the
detsch-e2e-test
branch
3 times, most recently
from
3ef6241
to
ab1fad4
Compare
mike-sul
approved these changes
Oct 22, 2024
detsch
force-pushed
the
detsch-e2e-test
branch
from
ab1fad4
to
43ed823
Compare
mike-sul
approved these changes
Oct 24, 2024
This includes docker compose app and container based on the one available in the sotactl project. Environment allows registration and updates of a pseudo device, communication with an actual backend. Signed-off-by: Andre Detsch <[email protected]>
The script contains a series of tests based on real targets available at a specific test factory. Signed-off-by: Andre Detsch <[email protected]>
It uses the following GitHub secrets: - E2E_TEST_FACTORY - E2E_TEST_BASE_TARGET_VERSION - E2E_TEST_USER_TOKEN Signed-off-by: Andre Detsch <[email protected]>
Code based on sotactl Makefile. Signed-off-by: Andre Detsch <[email protected]>
Signed-off-by: Andre Detsch <[email protected]>
Based on sotactl README.md. Signed-off-by: Andre Detsch <[email protected]>
detsch
force-pushed
the
detsch-e2e-test
branch
from
43ed823
to
3679f36
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Preliminar PR to facilitate discussion.
@mike-sul you can run the tests using:
On the first run, the device will be registered automatically.
There are some easy improvements to be done in the test script, but my next step is to try and run it as a github action.
My idea is to increase the tests combinations, perhaps having a "fast" mode that runs in github, with no more than 50 update operations, and a slower mode that goes through some unusual update sequences and variations on the apps configuration, increasing the chances to hit some new unexpected situation.
The targets in the factory where created almost automatically, but copying some applications I already had. We can re-create them as needed, but the current concept is to keep using always the same set of targets, until we believe that we need different ones.