Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] Fix CI issues #2084

Merged
merged 9 commits into from
Apr 17, 2024
Merged

[CI] Fix CI issues #2084

merged 9 commits into from
Apr 17, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Apr 17, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Apr 17, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2084

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 30 Unrelated Failures

As of commit e29113f with merge base 8570bd3 (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 17, 2024
@vmoens vmoens added CI Has to do with CI setup (e.g. wheels & builds, tests...) Environments Adds or modifies an environment wrapper Data Data-related PR, will launch data-related jobs labels Apr 17, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 17, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}12$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 52.8307ms 51.9092ms 19.2644 Ops/s 17.6255 Ops/s $\textbf{\color{#35bf28}+9.30\%}$
test_sync 44.9144ms 31.5386ms 31.7072 Ops/s 32.7830 Ops/s $\color{#d91a1a}-3.28\%$
test_async 55.6866ms 25.8995ms 38.6107 Ops/s 38.4278 Ops/s $\color{#35bf28}+0.48\%$
test_simple 0.4196s 0.3485s 2.8691 Ops/s 2.9224 Ops/s $\color{#d91a1a}-1.82\%$
test_transformed 0.5379s 0.4906s 2.0385 Ops/s 2.0639 Ops/s $\color{#d91a1a}-1.23\%$
test_serial 1.2715s 1.2024s 0.8317 Ops/s 0.8274 Ops/s $\color{#35bf28}+0.52\%$
test_parallel 1.0554s 0.9961s 1.0039 Ops/s 0.9959 Ops/s $\color{#35bf28}+0.80\%$
test_step_mdp_speed[True-True-True-True-True] 68.1180μs 21.2886μs 46.9734 KOps/s 47.3118 KOps/s $\color{#d91a1a}-0.72\%$
test_step_mdp_speed[True-True-True-True-False] 46.6480μs 13.0782μs 76.4631 KOps/s 77.5331 KOps/s $\color{#d91a1a}-1.38\%$
test_step_mdp_speed[True-True-True-False-True] 46.3570μs 12.5852μs 79.4587 KOps/s 79.9478 KOps/s $\color{#d91a1a}-0.61\%$
test_step_mdp_speed[True-True-True-False-False] 24.4260μs 7.6592μs 130.5624 KOps/s 131.8858 KOps/s $\color{#d91a1a}-1.00\%$
test_step_mdp_speed[True-True-False-True-True] 62.8280μs 22.7450μs 43.9656 KOps/s 44.2666 KOps/s $\color{#d91a1a}-0.68\%$
test_step_mdp_speed[True-True-False-True-False] 47.5400μs 14.2999μs 69.9307 KOps/s 70.4435 KOps/s $\color{#d91a1a}-0.73\%$
test_step_mdp_speed[True-True-False-False-True] 41.5180μs 13.6762μs 73.1195 KOps/s 73.0866 KOps/s $\color{#35bf28}+0.05\%$
test_step_mdp_speed[True-True-False-False-False] 34.8050μs 8.6572μs 115.5109 KOps/s 114.0420 KOps/s $\color{#35bf28}+1.29\%$
test_step_mdp_speed[True-False-True-True-True] 51.8380μs 23.9767μs 41.7072 KOps/s 42.0347 KOps/s $\color{#d91a1a}-0.78\%$
test_step_mdp_speed[True-False-True-True-False] 43.0510μs 15.5803μs 64.1836 KOps/s 64.0600 KOps/s $\color{#35bf28}+0.19\%$
test_step_mdp_speed[True-False-True-False-True] 33.5630μs 13.8954μs 71.9661 KOps/s 73.2911 KOps/s $\color{#d91a1a}-1.81\%$
test_step_mdp_speed[True-False-True-False-False] 34.5950μs 8.8401μs 113.1203 KOps/s 113.0731 KOps/s $\color{#35bf28}+0.04\%$
test_step_mdp_speed[True-False-False-True-True] 59.0420μs 25.5371μs 39.1587 KOps/s 39.9480 KOps/s $\color{#d91a1a}-1.98\%$
test_step_mdp_speed[True-False-False-True-False] 47.9800μs 16.4899μs 60.6430 KOps/s 59.6468 KOps/s $\color{#35bf28}+1.67\%$
test_step_mdp_speed[True-False-False-False-True] 60.8240μs 14.7339μs 67.8708 KOps/s 67.8031 KOps/s $\color{#35bf28}+0.10\%$
test_step_mdp_speed[True-False-False-False-False] 49.2330μs 9.9140μs 100.8673 KOps/s 100.1526 KOps/s $\color{#35bf28}+0.71\%$
test_step_mdp_speed[False-True-True-True-True] 57.1370μs 24.4313μs 40.9311 KOps/s 41.7472 KOps/s $\color{#d91a1a}-1.95\%$
test_step_mdp_speed[False-True-True-True-False] 39.3940μs 15.5383μs 64.3573 KOps/s 64.5800 KOps/s $\color{#d91a1a}-0.34\%$
test_step_mdp_speed[False-True-True-False-True] 37.4710μs 16.1184μs 62.0410 KOps/s 63.1914 KOps/s $\color{#d91a1a}-1.82\%$
test_step_mdp_speed[False-True-True-False-False] 41.3680μs 10.1460μs 98.5610 KOps/s 100.9522 KOps/s $\color{#d91a1a}-2.37\%$
test_step_mdp_speed[False-True-False-True-True] 38.5120μs 25.5436μs 39.1488 KOps/s 39.6120 KOps/s $\color{#d91a1a}-1.17\%$
test_step_mdp_speed[False-True-False-True-False] 49.9840μs 17.0843μs 58.5333 KOps/s 61.3747 KOps/s $\color{#d91a1a}-4.63\%$
test_step_mdp_speed[False-True-False-False-True] 44.8040μs 17.1079μs 58.4525 KOps/s 58.6820 KOps/s $\color{#d91a1a}-0.39\%$
test_step_mdp_speed[False-True-False-False-False] 36.8290μs 11.1875μs 89.3855 KOps/s 90.4798 KOps/s $\color{#d91a1a}-1.21\%$
test_step_mdp_speed[False-False-True-True-True] 70.0110μs 26.6249μs 37.5589 KOps/s 38.1937 KOps/s $\color{#d91a1a}-1.66\%$
test_step_mdp_speed[False-False-True-True-False] 58.5800μs 17.9631μs 55.6695 KOps/s 55.9649 KOps/s $\color{#d91a1a}-0.53\%$
test_step_mdp_speed[False-False-True-False-True] 54.6220μs 17.2342μs 58.0240 KOps/s 58.6809 KOps/s $\color{#d91a1a}-1.12\%$
test_step_mdp_speed[False-False-True-False-False] 45.6360μs 11.1668μs 89.5515 KOps/s 88.6075 KOps/s $\color{#35bf28}+1.07\%$
test_step_mdp_speed[False-False-False-True-True] 64.9520μs 27.8698μs 35.8811 KOps/s 36.5347 KOps/s $\color{#d91a1a}-1.79\%$
test_step_mdp_speed[False-False-False-True-False] 73.3880μs 18.9864μs 52.6693 KOps/s 52.7811 KOps/s $\color{#d91a1a}-0.21\%$
test_step_mdp_speed[False-False-False-False-True] 50.9960μs 17.9983μs 55.5607 KOps/s 55.5305 KOps/s $\color{#35bf28}+0.05\%$
test_step_mdp_speed[False-False-False-False-False] 37.0900μs 12.5848μs 79.4612 KOps/s 81.7186 KOps/s $\color{#d91a1a}-2.76\%$
test_values[generalized_advantage_estimate-True-True] 9.4870ms 9.2757ms 107.8090 Ops/s 106.4252 Ops/s $\color{#35bf28}+1.30\%$
test_values[vec_generalized_advantage_estimate-True-True] 35.0992ms 33.3587ms 29.9772 Ops/s 28.0450 Ops/s $\textbf{\color{#35bf28}+6.89\%}$
test_values[td0_return_estimate-False-False] 0.2231ms 0.1726ms 5.7947 KOps/s 5.5973 KOps/s $\color{#35bf28}+3.53\%$
test_values[td1_return_estimate-False-False] 25.4745ms 22.9861ms 43.5045 Ops/s 42.9745 Ops/s $\color{#35bf28}+1.23\%$
test_values[vec_td1_return_estimate-False-False] 34.6750ms 33.4638ms 29.8831 Ops/s 27.9782 Ops/s $\textbf{\color{#35bf28}+6.81\%}$
test_values[td_lambda_return_estimate-True-False] 33.5348ms 33.0425ms 30.2641 Ops/s 29.4610 Ops/s $\color{#35bf28}+2.73\%$
test_values[vec_td_lambda_return_estimate-True-False] 34.7360ms 33.4008ms 29.9394 Ops/s 27.9570 Ops/s $\textbf{\color{#35bf28}+7.09\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.2813ms 8.0655ms 123.9850 Ops/s 123.2495 Ops/s $\color{#35bf28}+0.60\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.3954ms 1.9751ms 506.3115 Ops/s 540.9679 Ops/s $\textbf{\color{#d91a1a}-6.41\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5664ms 0.3501ms 2.8562 KOps/s 2.8300 KOps/s $\color{#35bf28}+0.92\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 47.1621ms 46.0133ms 21.7328 Ops/s 21.6622 Ops/s $\color{#35bf28}+0.33\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.8308ms 3.0347ms 329.5254 Ops/s 323.3290 Ops/s $\color{#35bf28}+1.92\%$
test_dqn_speed 6.4938ms 1.3316ms 751.0019 Ops/s 735.4340 Ops/s $\color{#35bf28}+2.12\%$
test_ddpg_speed 3.8356ms 2.6776ms 373.4658 Ops/s 356.9427 Ops/s $\color{#35bf28}+4.63\%$
test_sac_speed 9.0333ms 8.2551ms 121.1372 Ops/s 115.9589 Ops/s $\color{#35bf28}+4.47\%$
test_redq_speed 23.4428ms 14.0586ms 71.1308 Ops/s 70.8483 Ops/s $\color{#35bf28}+0.40\%$
test_redq_deprec_speed 0.1024s 15.4465ms 64.7396 Ops/s 70.8419 Ops/s $\textbf{\color{#d91a1a}-8.61\%}$
test_td3_speed 10.1811ms 8.4941ms 117.7288 Ops/s 120.5655 Ops/s $\color{#d91a1a}-2.35\%$
test_cql_speed 38.4495ms 36.7958ms 27.1770 Ops/s 27.0971 Ops/s $\color{#35bf28}+0.30\%$
test_a2c_speed 8.1000ms 7.4695ms 133.8772 Ops/s 123.5354 Ops/s $\textbf{\color{#35bf28}+8.37\%}$
test_ppo_speed 9.0725ms 7.7068ms 129.7560 Ops/s 122.9046 Ops/s $\textbf{\color{#35bf28}+5.57\%}$
test_reinforce_speed 7.3453ms 6.6979ms 149.3000 Ops/s 150.5430 Ops/s $\color{#d91a1a}-0.83\%$
test_iql_speed 34.6625ms 33.4485ms 29.8967 Ops/s 29.7630 Ops/s $\color{#35bf28}+0.45\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.3912ms 2.4093ms 415.0617 Ops/s 412.8591 Ops/s $\color{#35bf28}+0.53\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.1443ms 0.4919ms 2.0330 KOps/s 1.9138 KOps/s $\textbf{\color{#35bf28}+6.22\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7533ms 0.4616ms 2.1662 KOps/s 2.1045 KOps/s $\color{#35bf28}+2.93\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.6089ms 2.2819ms 438.2407 Ops/s 406.6220 Ops/s $\textbf{\color{#35bf28}+7.78\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0634ms 0.4917ms 2.0338 KOps/s 2.0041 KOps/s $\color{#35bf28}+1.48\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7921ms 0.4613ms 2.1679 KOps/s 2.0869 KOps/s $\color{#35bf28}+3.88\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.4851ms 1.2198ms 819.7848 Ops/s 803.1825 Ops/s $\color{#35bf28}+2.07\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.7284ms 1.1635ms 859.4830 Ops/s 877.4985 Ops/s $\color{#d91a1a}-2.05\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.7396ms 2.6049ms 383.8927 Ops/s 389.6205 Ops/s $\color{#d91a1a}-1.47\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0672ms 0.6241ms 1.6023 KOps/s 1.6237 KOps/s $\color{#d91a1a}-1.32\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9167ms 0.5966ms 1.6761 KOps/s 1.6676 KOps/s $\color{#35bf28}+0.51\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.7510ms 2.4273ms 411.9783 Ops/s 404.0548 Ops/s $\color{#35bf28}+1.96\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9542ms 0.4881ms 2.0489 KOps/s 1.9609 KOps/s $\color{#35bf28}+4.49\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7048ms 0.4659ms 2.1465 KOps/s 2.0116 KOps/s $\textbf{\color{#35bf28}+6.71\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.5929ms 2.2938ms 435.9554 Ops/s 384.2272 Ops/s $\textbf{\color{#35bf28}+13.46\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6125ms 0.4844ms 2.0642 KOps/s 1.9752 KOps/s $\color{#35bf28}+4.51\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 3.5153ms 0.4645ms 2.1529 KOps/s 2.0675 KOps/s $\color{#35bf28}+4.13\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.8556ms 2.4351ms 410.6653 Ops/s 377.7023 Ops/s $\textbf{\color{#35bf28}+8.73\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1765ms 0.6141ms 1.6283 KOps/s 1.5987 KOps/s $\color{#35bf28}+1.85\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7553ms 0.5825ms 1.7167 KOps/s 1.6799 KOps/s $\color{#35bf28}+2.19\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1111s 7.9928ms 125.1125 Ops/s 121.1256 Ops/s $\color{#35bf28}+3.29\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 15.6176ms 12.6227ms 79.2224 Ops/s 82.2264 Ops/s $\color{#d91a1a}-3.65\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.6829ms 1.1017ms 907.6674 Ops/s 907.4558 Ops/s $\color{#35bf28}+0.02\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 98.0056ms 5.6246ms 177.7903 Ops/s 167.8417 Ops/s $\textbf{\color{#35bf28}+5.93\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.1067s 14.0857ms 70.9940 Ops/s 69.4484 Ops/s $\color{#35bf28}+2.23\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 4.6227ms 1.1742ms 851.6313 Ops/s 867.5861 Ops/s $\color{#d91a1a}-1.84\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1071s 6.2751ms 159.3595 Ops/s 156.5302 Ops/s $\color{#35bf28}+1.81\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 15.2611ms 12.5551ms 79.6492 Ops/s 76.0919 Ops/s $\color{#35bf28}+4.67\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 4.2636ms 1.4618ms 684.0741 Ops/s 701.3694 Ops/s $\color{#d91a1a}-2.47\%$

@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 17, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}7$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1021s 0.1011s 9.8959 Ops/s 9.5528 Ops/s $\color{#35bf28}+3.59\%$
test_sync 86.9380ms 86.4576ms 11.5664 Ops/s 11.4898 Ops/s $\color{#35bf28}+0.67\%$
test_async 0.1648s 71.5192ms 13.9823 Ops/s 14.1025 Ops/s $\color{#d91a1a}-0.85\%$
test_single_pixels 0.1119s 0.1117s 8.9522 Ops/s 9.1107 Ops/s $\color{#d91a1a}-1.74\%$
test_sync_pixels 68.9822ms 66.6075ms 15.0133 Ops/s 14.9009 Ops/s $\color{#35bf28}+0.75\%$
test_async_pixels 0.1230s 55.6395ms 17.9728 Ops/s 17.9856 Ops/s $\color{#d91a1a}-0.07\%$
test_simple 0.6819s 0.6788s 1.4732 Ops/s 1.4687 Ops/s $\color{#35bf28}+0.30\%$
test_transformed 0.9104s 0.9055s 1.1043 Ops/s 1.1091 Ops/s $\color{#d91a1a}-0.43\%$
test_serial 2.1877s 2.1265s 0.4703 Ops/s 0.4830 Ops/s $\color{#d91a1a}-2.64\%$
test_parallel 1.8742s 1.8133s 0.5515 Ops/s 0.5578 Ops/s $\color{#d91a1a}-1.13\%$
test_step_mdp_speed[True-True-True-True-True] 65.0010μs 32.9338μs 30.3639 KOps/s 31.0565 KOps/s $\color{#d91a1a}-2.23\%$
test_step_mdp_speed[True-True-True-True-False] 42.0510μs 20.2037μs 49.4960 KOps/s 52.2321 KOps/s $\textbf{\color{#d91a1a}-5.24\%}$
test_step_mdp_speed[True-True-True-False-True] 34.4910μs 18.8350μs 53.0926 KOps/s 55.7325 KOps/s $\color{#d91a1a}-4.74\%$
test_step_mdp_speed[True-True-True-False-False] 28.2610μs 11.2443μs 88.9340 KOps/s 90.7632 KOps/s $\color{#d91a1a}-2.02\%$
test_step_mdp_speed[True-True-False-True-True] 50.0710μs 35.3032μs 28.3260 KOps/s 29.3076 KOps/s $\color{#d91a1a}-3.35\%$
test_step_mdp_speed[True-True-False-True-False] 38.2610μs 21.8593μs 45.7471 KOps/s 47.5560 KOps/s $\color{#d91a1a}-3.80\%$
test_step_mdp_speed[True-True-False-False-True] 39.5800μs 20.3963μs 49.0284 KOps/s 50.0557 KOps/s $\color{#d91a1a}-2.05\%$
test_step_mdp_speed[True-True-False-False-False] 29.5910μs 13.1843μs 75.8475 KOps/s 77.8232 KOps/s $\color{#d91a1a}-2.54\%$
test_step_mdp_speed[True-False-True-True-True] 62.0110μs 36.7767μs 27.1911 KOps/s 28.3633 KOps/s $\color{#d91a1a}-4.13\%$
test_step_mdp_speed[True-False-True-True-False] 44.9110μs 23.6476μs 42.2875 KOps/s 44.0691 KOps/s $\color{#d91a1a}-4.04\%$
test_step_mdp_speed[True-False-True-False-True] 35.7310μs 20.4596μs 48.8768 KOps/s 50.7246 KOps/s $\color{#d91a1a}-3.64\%$
test_step_mdp_speed[True-False-True-False-False] 32.1510μs 13.0940μs 76.3706 KOps/s 78.8824 KOps/s $\color{#d91a1a}-3.18\%$
test_step_mdp_speed[True-False-False-True-True] 55.5410μs 38.3060μs 26.1056 KOps/s 26.9649 KOps/s $\color{#d91a1a}-3.19\%$
test_step_mdp_speed[True-False-False-True-False] 43.6410μs 25.2660μs 39.5789 KOps/s 40.6330 KOps/s $\color{#d91a1a}-2.59\%$
test_step_mdp_speed[True-False-False-False-True] 47.9510μs 22.0996μs 45.2497 KOps/s 46.7211 KOps/s $\color{#d91a1a}-3.15\%$
test_step_mdp_speed[True-False-False-False-False] 30.3900μs 14.8792μs 67.2078 KOps/s 68.9216 KOps/s $\color{#d91a1a}-2.49\%$
test_step_mdp_speed[False-True-True-True-True] 55.5010μs 36.8048μs 27.1703 KOps/s 27.5655 KOps/s $\color{#d91a1a}-1.43\%$
test_step_mdp_speed[False-True-True-True-False] 64.8700μs 23.6096μs 42.3557 KOps/s 43.3189 KOps/s $\color{#d91a1a}-2.22\%$
test_step_mdp_speed[False-True-True-False-True] 49.4510μs 24.5792μs 40.6848 KOps/s 42.5176 KOps/s $\color{#d91a1a}-4.31\%$
test_step_mdp_speed[False-True-True-False-False] 70.8320μs 15.1492μs 66.0100 KOps/s 68.9088 KOps/s $\color{#d91a1a}-4.21\%$
test_step_mdp_speed[False-True-False-True-True] 95.3920μs 39.2744μs 25.4619 KOps/s 26.1814 KOps/s $\color{#d91a1a}-2.75\%$
test_step_mdp_speed[False-True-False-True-False] 48.2810μs 26.3050μs 38.0155 KOps/s 40.5637 KOps/s $\textbf{\color{#d91a1a}-6.28\%}$
test_step_mdp_speed[False-True-False-False-True] 41.9410μs 26.2139μs 38.1478 KOps/s 39.8488 KOps/s $\color{#d91a1a}-4.27\%$
test_step_mdp_speed[False-True-False-False-False] 36.1210μs 16.9878μs 58.8656 KOps/s 61.1706 KOps/s $\color{#d91a1a}-3.77\%$
test_step_mdp_speed[False-False-True-True-True] 67.5810μs 41.1028μs 24.3292 KOps/s 25.7898 KOps/s $\textbf{\color{#d91a1a}-5.66\%}$
test_step_mdp_speed[False-False-True-True-False] 90.4620μs 27.6992μs 36.1021 KOps/s 37.6753 KOps/s $\color{#d91a1a}-4.18\%$
test_step_mdp_speed[False-False-True-False-True] 43.8910μs 26.3333μs 37.9747 KOps/s 39.8680 KOps/s $\color{#d91a1a}-4.75\%$
test_step_mdp_speed[False-False-True-False-False] 33.4710μs 17.2504μs 57.9697 KOps/s 61.3034 KOps/s $\textbf{\color{#d91a1a}-5.44\%}$
test_step_mdp_speed[False-False-False-True-True] 64.7910μs 42.4532μs 23.5554 KOps/s 24.7950 KOps/s $\color{#d91a1a}-5.00\%$
test_step_mdp_speed[False-False-False-True-False] 45.3210μs 29.2843μs 34.1480 KOps/s 35.6432 KOps/s $\color{#d91a1a}-4.19\%$
test_step_mdp_speed[False-False-False-False-True] 52.8710μs 27.8430μs 35.9157 KOps/s 37.7671 KOps/s $\color{#d91a1a}-4.90\%$
test_step_mdp_speed[False-False-False-False-False] 33.8710μs 18.7409μs 53.3592 KOps/s 55.0396 KOps/s $\color{#d91a1a}-3.05\%$
test_values[generalized_advantage_estimate-True-True] 26.4267ms 25.2088ms 39.6687 Ops/s 41.5200 Ops/s $\color{#d91a1a}-4.46\%$
test_values[vec_generalized_advantage_estimate-True-True] 88.6149ms 3.3436ms 299.0801 Ops/s 306.1750 Ops/s $\color{#d91a1a}-2.32\%$
test_values[td0_return_estimate-False-False] 94.3020μs 64.1165μs 15.5966 KOps/s 15.9881 KOps/s $\color{#d91a1a}-2.45\%$
test_values[td1_return_estimate-False-False] 55.6306ms 53.8876ms 18.5571 Ops/s 19.3412 Ops/s $\color{#d91a1a}-4.05\%$
test_values[vec_td1_return_estimate-False-False] 2.0821ms 1.7653ms 566.4913 Ops/s 572.0490 Ops/s $\color{#d91a1a}-0.97\%$
test_values[td_lambda_return_estimate-True-False] 88.7453ms 86.5670ms 11.5517 Ops/s 12.1580 Ops/s $\color{#d91a1a}-4.99\%$
test_values[vec_td_lambda_return_estimate-True-False] 2.1718ms 1.7653ms 566.4655 Ops/s 571.4792 Ops/s $\color{#d91a1a}-0.88\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 25.0680ms 24.7444ms 40.4133 Ops/s 44.4881 Ops/s $\textbf{\color{#d91a1a}-9.16\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8926ms 0.7036ms 1.4212 KOps/s 1.4508 KOps/s $\color{#d91a1a}-2.04\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7106ms 0.6522ms 1.5332 KOps/s 1.5643 KOps/s $\color{#d91a1a}-1.99\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5016ms 1.4552ms 687.1972 Ops/s 693.6604 Ops/s $\color{#d91a1a}-0.93\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9329ms 0.6703ms 1.4918 KOps/s 1.5119 KOps/s $\color{#d91a1a}-1.33\%$
test_dqn_speed 1.8449ms 1.4545ms 687.5321 Ops/s 702.8602 Ops/s $\color{#d91a1a}-2.18\%$
test_ddpg_speed 3.1310ms 2.7963ms 357.6130 Ops/s 366.3850 Ops/s $\color{#d91a1a}-2.39\%$
test_sac_speed 8.9231ms 8.3677ms 119.5068 Ops/s 123.4621 Ops/s $\color{#d91a1a}-3.20\%$
test_redq_speed 11.4595ms 10.5522ms 94.7669 Ops/s 95.7917 Ops/s $\color{#d91a1a}-1.07\%$
test_redq_deprec_speed 0.1022s 12.3992ms 80.6505 Ops/s 88.3031 Ops/s $\textbf{\color{#d91a1a}-8.67\%}$
test_td3_speed 8.4924ms 8.2865ms 120.6777 Ops/s 124.1031 Ops/s $\color{#d91a1a}-2.76\%$
test_cql_speed 27.7316ms 26.1843ms 38.1908 Ops/s 38.6998 Ops/s $\color{#d91a1a}-1.32\%$
test_a2c_speed 6.2765ms 5.7795ms 173.0253 Ops/s 181.0348 Ops/s $\color{#d91a1a}-4.42\%$
test_ppo_speed 6.2353ms 5.9691ms 167.5284 Ops/s 171.5333 Ops/s $\color{#d91a1a}-2.33\%$
test_reinforce_speed 4.8708ms 4.5710ms 218.7685 Ops/s 221.2417 Ops/s $\color{#d91a1a}-1.12\%$
test_iql_speed 20.2772ms 19.6331ms 50.9344 Ops/s 51.4545 Ops/s $\color{#d91a1a}-1.01\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.0870ms 2.9535ms 338.5836 Ops/s 346.9212 Ops/s $\color{#d91a1a}-2.40\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.1029s 0.6264ms 1.5965 KOps/s 1.8150 KOps/s $\textbf{\color{#d91a1a}-12.04\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7110ms 0.5254ms 1.9035 KOps/s 1.8870 KOps/s $\color{#35bf28}+0.87\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.3304ms 2.9572ms 338.1532 Ops/s 342.1694 Ops/s $\color{#d91a1a}-1.17\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.4404ms 0.5444ms 1.8369 KOps/s 1.8401 KOps/s $\color{#d91a1a}-0.18\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6850ms 0.5216ms 1.9171 KOps/s 1.9227 KOps/s $\color{#d91a1a}-0.29\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6429ms 1.4911ms 670.6433 Ops/s 688.3349 Ops/s $\color{#d91a1a}-2.57\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5797ms 1.4297ms 699.4508 Ops/s 721.1470 Ops/s $\color{#d91a1a}-3.01\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.3155ms 3.0745ms 325.2538 Ops/s 329.9378 Ops/s $\color{#d91a1a}-1.42\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8825ms 0.6783ms 1.4742 KOps/s 1.4672 KOps/s $\color{#35bf28}+0.48\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.5239ms 0.6588ms 1.5180 KOps/s 1.5085 KOps/s $\color{#35bf28}+0.63\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.1278ms 2.9620ms 337.6075 Ops/s 346.6417 Ops/s $\color{#d91a1a}-2.61\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7393ms 0.5473ms 1.8271 KOps/s 1.8216 KOps/s $\color{#35bf28}+0.30\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.4454ms 0.5355ms 1.8674 KOps/s 1.8932 KOps/s $\color{#d91a1a}-1.36\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.2463ms 2.9716ms 336.5189 Ops/s 342.5502 Ops/s $\color{#d91a1a}-1.76\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.4274ms 0.5477ms 1.8259 KOps/s 1.8388 KOps/s $\color{#d91a1a}-0.70\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6862ms 0.5262ms 1.9004 KOps/s 1.9077 KOps/s $\color{#d91a1a}-0.38\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.5188ms 3.0815ms 324.5222 Ops/s 330.6542 Ops/s $\color{#d91a1a}-1.85\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9348ms 0.6885ms 1.4524 KOps/s 1.4828 KOps/s $\color{#d91a1a}-2.05\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.6282ms 0.6624ms 1.5097 KOps/s 1.5148 KOps/s $\color{#d91a1a}-0.34\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1372s 9.7900ms 102.1451 Ops/s 104.1957 Ops/s $\color{#d91a1a}-1.97\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.2391ms 14.8207ms 67.4733 Ops/s 66.4605 Ops/s $\color{#35bf28}+1.52\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.0876ms 1.0996ms 909.3860 Ops/s 831.2126 Ops/s $\textbf{\color{#35bf28}+9.40\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1183s 7.1394ms 140.0682 Ops/s 139.2683 Ops/s $\color{#35bf28}+0.57\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.6196ms 15.1174ms 66.1488 Ops/s 69.5941 Ops/s $\color{#d91a1a}-4.95\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.3231ms 1.1506ms 869.1287 Ops/s 782.9338 Ops/s $\textbf{\color{#35bf28}+11.01\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1178s 7.4997ms 133.3384 Ops/s 102.1043 Ops/s $\textbf{\color{#35bf28}+30.59\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 18.0706ms 15.3445ms 65.1701 Ops/s 66.3325 Ops/s $\color{#d91a1a}-1.75\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.5626ms 1.4926ms 669.9514 Ops/s 625.2015 Ops/s $\textbf{\color{#35bf28}+7.16\%}$

@vmoens vmoens merged commit 730dd45 into main Apr 17, 2024
4 checks passed
@vmoens vmoens deleted the fix-conda branch April 17, 2024 13:05
vmoens added a commit that referenced this pull request Apr 17, 2024
@vmoens
[CI] Fix CI issues (#2084)
c875c84 
(cherry picked from commit 730dd45)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Data Data-related PR, will launch data-related jobs Environments Adds or modifies an environment wrapper
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot