Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flaky Trigger Engine Tests #976

Closed
eddbbt opened this issue Jul 12, 2024 · 1 comment
Closed

Flaky Trigger Engine Tests #976

eddbbt opened this issue Jul 12, 2024 · 1 comment

Comments

@eddbbt
Copy link
Contributor

eddbbt commented Jul 12, 2024

Sometimes Trigger Engine tests fail, this error is mostly due to an non-immediate deletion of entries in a process registry.

Usually, those have some kind of relationship with RabbitMQ (for example, see here )

This problem has been partially addressed in #915. A quick fix would be something similar, a better fix will require astarte and tests to address an eventual latency.

Steps to reproduce:

  • do a PR
  • wait for CI/CD workflows to run
  • now, sometimes tests randomly fails, and if you re-run them they will pass
  • you will spot those also because, inside the correspondent workflow log, there is no meaningful error for test failure or the error is about a library (this does not make any sense)

It would happen also that tests passes without errors this is not a symptom of a successful fix, it is mandatory to repeat the workflow to test its effectiveness.

Please note, this kind of test failure is difficult to notice in a local environment, mostly because GitHub environment is slower enough to trigger this behavior more frequently

example of randomly failing test
image

@eddbbt eddbbt changed the title Flaky Trigger Engine Tests Flaky Trigger Engine and Realm Management Tests Jul 12, 2024
@eddbbt eddbbt changed the title Flaky Trigger Engine and Realm Management Tests Flaky Trigger Engine Tests Jul 12, 2024
@eddbbt
Copy link
Contributor Author

eddbbt commented Nov 28, 2024

resolved by #1017

@eddbbt eddbbt closed this as completed Nov 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant