Skip to content

Commit

Permalink
chore: extract flaky tests from nayduck ci (#12154)
Browse files Browse the repository at this point in the history
These tests should be run on day-to-day basis to monitor progress. But
merge on CI should be blocked only by reliable tests.
  • Loading branch information
Longarithm authored Sep 26, 2024
1 parent 3e92457 commit 3f5556b
Show file tree
Hide file tree
Showing 3 changed files with 22 additions and 22 deletions.
23 changes: 22 additions & 1 deletion nightly/nightly.txt
Original file line number Diff line number Diff line change
@@ -1,4 +1,25 @@
./sandbox.txt
./pytest.txt
./expensive.txt
./very_expensive.txt

# Very expensive catchup tests
expensive --timeout=3600 near-client near_client tests::catching_up::test_all_chunks_accepted_1000
expensive --timeout=3600 near-client near_client tests::catching_up::test_all_chunks_accepted_1000 --features nightly
expensive --timeout=7200 near-client near_client tests::catching_up::test_all_chunks_accepted_1000_slow
expensive --timeout=7200 near-client near_client tests::catching_up::test_all_chunks_accepted_1000_slow --features nightly
expensive --timeout=1800 near-client near_client tests::catching_up::test_all_chunks_accepted_1000_rare_epoch_changing
expensive --timeout=1800 near-client near_client tests::catching_up::test_all_chunks_accepted_1000_rare_epoch_changing --features nightly

# Very expensive test: make sure Docker image can be build and run
pytest --skip-build --timeout=1h sanity/docker.py

### Flaky tests. Should be fixed to be added to CI and added back to pytest-sanity.txt
pytest --timeout=120 sanity/garbage_collection.py
pytest --timeout=120 sanity/garbage_collection.py --features nightly
pytest --timeout=120 sanity/validator_switch_key_quick.py
pytest --timeout=120 sanity/validator_switch_key_quick.py --features nightly
pytest --timeout=600 sanity/state_sync_routed.py manytx 115
pytest --timeout=600 sanity/state_sync_routed.py manytx 115 --features nightly
# Tests for split storage and split storage migration
pytest --timeout=600 sanity/split_storage.py
pytest --timeout=600 sanity/split_storage.py --features nightly
10 changes: 0 additions & 10 deletions nightly/pytest-sanity.txt
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,6 @@ pytest --timeout=240 sanity/state_sync4.py
pytest --timeout=240 sanity/state_sync4.py --features nightly
pytest --timeout=240 sanity/state_sync5.py
pytest --timeout=240 sanity/state_sync5.py --features nightly
pytest --timeout=600 sanity/state_sync_routed.py manytx 115
pytest --timeout=600 sanity/state_sync_routed.py manytx 115 --features nightly
# TODO(#4618): Those tests are currently broken. Comment out while we’re
# working on a fix / deciding whether to remove them.
#pytest --timeout=300 sanity/state_sync_late.py notx
Expand Down Expand Up @@ -89,8 +87,6 @@ pytest sanity/rpc_max_gas_burnt.py
pytest sanity/rpc_max_gas_burnt.py --features nightly
pytest sanity/rpc_tx_status.py
pytest sanity/rpc_tx_status.py --features nightly
pytest --timeout=120 sanity/garbage_collection.py
pytest --timeout=120 sanity/garbage_collection.py --features nightly
pytest --timeout=120 sanity/garbage_collection1.py
pytest --timeout=120 sanity/garbage_collection1.py --features nightly
pytest --timeout=180 sanity/garbage_collection_intense.py
Expand All @@ -113,8 +109,6 @@ pytest sanity/repro_2916.py
pytest sanity/repro_2916.py --features nightly
pytest --timeout=240 sanity/switch_node_key.py
pytest --timeout=240 sanity/switch_node_key.py --features nightly
pytest --timeout=120 sanity/validator_switch_key_quick.py
pytest --timeout=120 sanity/validator_switch_key_quick.py --features nightly
pytest --timeout=120 sanity/validator_remove_key_quick.py
pytest --timeout=120 sanity/validator_remove_key_quick.py --features nightly
pytest --timeout=60 sanity/shadow_tracking.py
Expand Down Expand Up @@ -162,10 +156,6 @@ pytest sanity/rosetta.py --features nightly
# This is the test for meta transactions.
pytest sanity/meta_tx.py --features nightly

# Tests for split storage and split storage migration
pytest --timeout=600 sanity/split_storage.py
pytest --timeout=600 sanity/split_storage.py --features nightly

# Tests for resharding
# TODO(resharding) Tests for resharding are disabled because resharding is not
# compatible with stateless validation, state sync and congestion control.
Expand Down
11 changes: 0 additions & 11 deletions nightly/very_expensive.txt

This file was deleted.

0 comments on commit 3f5556b

Please sign in to comment.