Skip to content

integration: increase timestamp tolerance in Timestamps test #313

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jun 4, 2025

Conversation

wprzytula
Copy link
Collaborator

The Timestamps test in the integration suite was failing due to the timestamp difference being bigger than the tolerated threshold. Git blame reveals that the threshold was alread increased from 100ms to 150ms by Gor in 2022. I assume 500 ms will be enough for now.

A question aside is whether this test comparison gives us any benefit at all. It seems to be a flaky test that is not very useful. Perhaps we should consider just removing this flaky timing-based check.

Fixes: #312

Pre-review checklist

  • I have split my patch into logically separate commits.
  • All commit messages clearly explain what they change and why.
  • PR description sums up the changes and reasons why they should be introduced.
  • [ ] I have implemented Rust unit tests for the features/changes introduced.
  • [ ] I have enabled appropriate tests in .github/workflows/build.yml in gtest_filter.
  • [ ] I have enabled appropriate tests in .github/workflows/cassandra.yml in gtest_filter.

The Timestamps test in the integration suite was failing due
to the timestamp difference being bigger than the tolerated threshold.
Git blame reveals that the threshold was alread increased from 100ms
to 150ms by Gor in 2022. I assume 500 ms will be enough for now.

A question aside is whether this test comparison gives us any benefit
at all. It seems to be a flaky test that is not very useful.
Perhaps we should consider just removing this flaky timing-based check.
@wprzytula wprzytula requested a review from Lorak-mmk June 4, 2025 08:34
@wprzytula wprzytula self-assigned this Jun 4, 2025
@wprzytula wprzytula added the CI Related to continuous integration label Jun 4, 2025
@wprzytula wprzytula added this to the 0.5 milestone Jun 4, 2025
@wprzytula wprzytula merged commit fa0c987 into scylladb:master Jun 4, 2025
12 checks passed
@wprzytula wprzytula deleted the make-flaky-test-less-flaky branch June 4, 2025 09:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI Related to continuous integration
Projects
None yet
Development

Successfully merging this pull request may close these issues.

BasicsTests.Integration_Cassandra_Timestamps is flaky
2 participants