-
Notifications
You must be signed in to change notification settings - Fork 51
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Jepsen tests to CI workflow #2774
base: main
Are you sure you want to change the base?
Conversation
56b3194
to
2e79431
Compare
1eac129
to
923afd0
Compare
# additional features added for CI validation builds only | ||
features: metadata-api |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is only enabled on the internal docker artifact we attach to the workflow run - same one that gets used by the SDK tests.
jepsen: | ||
needs: docker |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This test currently runs after docker
, just like the SDK tests. At the moment it takes ~3 min but we can tune it to run for shorter or longer. The downside is that there's a single Jepsen workers cluster backing it so we need to run multiple PRs sequentially. As long as there isn't a big backlog of PRs, it shouldn't add any more time to the overall PR checks duration.
id-token: write # NB: can obtain OIDC tokens on behalf of this repository! | ||
steps: | ||
- uses: restatedev/jepsen/.github/actions/run-tests@reusable | ||
continue-on-error: true |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I expect this will be flaky for a while - I believe this will make it report error but not block PR merging. But, I may be wrong about how this behaves :-)
9737d1c
to
8116cc0
Compare
A long time coming but finally ready to merge - adds a step to run the https://github.com/restatedev/jepsen suite (and specifically, the
set-vo
andset-mds
workloads) against open PRs.