Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Versioning] New torch version #2110

Merged
merged 4 commits into from
Apr 25, 2024
Merged

[Versioning] New torch version #2110

merged 4 commits into from
Apr 25, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Apr 24, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Apr 24, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2110

Note: Links to docs will display an error until the docs builds have been completed.

❌ 9 New Failures, 14 Unrelated Failures

As of commit d88c6cd with merge base 62a3adb (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 24, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 25, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}10$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 52.5804ms 51.9105ms 19.2639 Ops/s 18.8095 Ops/s $\color{#35bf28}+2.42\%$
test_sync 39.8771ms 29.6550ms 33.7211 Ops/s 29.4858 Ops/s $\textbf{\color{#35bf28}+14.36\%}$
test_async 48.9132ms 27.1602ms 36.8185 Ops/s 36.3748 Ops/s $\color{#35bf28}+1.22\%$
test_simple 0.4035s 0.3447s 2.9013 Ops/s 2.9925 Ops/s $\color{#d91a1a}-3.05\%$
test_transformed 0.4743s 0.4720s 2.1185 Ops/s 2.0131 Ops/s $\textbf{\color{#35bf28}+5.24\%}$
test_serial 1.2253s 1.1829s 0.8454 Ops/s 0.8329 Ops/s $\color{#35bf28}+1.51\%$
test_parallel 1.0426s 0.9992s 1.0008 Ops/s 0.9911 Ops/s $\color{#35bf28}+0.99\%$
test_step_mdp_speed[True-True-True-True-True] 0.1908ms 21.2933μs 46.9630 KOps/s 45.7692 KOps/s $\color{#35bf28}+2.61\%$
test_step_mdp_speed[True-True-True-True-False] 55.8340μs 13.1516μs 76.0366 KOps/s 73.9591 KOps/s $\color{#35bf28}+2.81\%$
test_step_mdp_speed[True-True-True-False-True] 27.4600μs 12.7191μs 78.6217 KOps/s 77.2397 KOps/s $\color{#35bf28}+1.79\%$
test_step_mdp_speed[True-True-True-False-False] 55.2920μs 7.6928μs 129.9918 KOps/s 126.5922 KOps/s $\color{#35bf28}+2.69\%$
test_step_mdp_speed[True-True-False-True-True] 57.8260μs 22.7445μs 43.9667 KOps/s 43.1689 KOps/s $\color{#35bf28}+1.85\%$
test_step_mdp_speed[True-True-False-True-False] 34.7130μs 14.4666μs 69.1246 KOps/s 68.0785 KOps/s $\color{#35bf28}+1.54\%$
test_step_mdp_speed[True-True-False-False-True] 40.6440μs 13.9066μs 71.9084 KOps/s 70.3353 KOps/s $\color{#35bf28}+2.24\%$
test_step_mdp_speed[True-True-False-False-False] 36.5170μs 9.0385μs 110.6378 KOps/s 108.9308 KOps/s $\color{#35bf28}+1.57\%$
test_step_mdp_speed[True-False-True-True-True] 58.1780μs 24.5563μs 40.7227 KOps/s 40.2841 KOps/s $\color{#35bf28}+1.09\%$
test_step_mdp_speed[True-False-True-True-False] 62.3650μs 15.8282μs 63.1783 KOps/s 61.4828 KOps/s $\color{#35bf28}+2.76\%$
test_step_mdp_speed[True-False-True-False-True] 51.8760μs 14.1116μs 70.8637 KOps/s 69.8555 KOps/s $\color{#35bf28}+1.44\%$
test_step_mdp_speed[True-False-True-False-False] 45.0830μs 9.0472μs 110.5313 KOps/s 100.9367 KOps/s $\textbf{\color{#35bf28}+9.51\%}$
test_step_mdp_speed[True-False-False-True-True] 60.1510μs 25.5648μs 39.1163 KOps/s 36.3695 KOps/s $\textbf{\color{#35bf28}+7.55\%}$
test_step_mdp_speed[True-False-False-True-False] 62.7860μs 17.0797μs 58.5491 KOps/s 58.4751 KOps/s $\color{#35bf28}+0.13\%$
test_step_mdp_speed[True-False-False-False-True] 47.0170μs 15.0581μs 66.4094 KOps/s 65.0272 KOps/s $\color{#35bf28}+2.13\%$
test_step_mdp_speed[True-False-False-False-False] 32.9300μs 10.2218μs 97.8301 KOps/s 96.2743 KOps/s $\color{#35bf28}+1.62\%$
test_step_mdp_speed[False-True-True-True-True] 54.3910μs 24.3237μs 41.1121 KOps/s 40.5491 KOps/s $\color{#35bf28}+1.39\%$
test_step_mdp_speed[False-True-True-True-False] 41.4370μs 15.7689μs 63.4158 KOps/s 62.1907 KOps/s $\color{#35bf28}+1.97\%$
test_step_mdp_speed[False-True-True-False-True] 61.7540μs 16.1734μs 61.8299 KOps/s 60.2865 KOps/s $\color{#35bf28}+2.56\%$
test_step_mdp_speed[False-True-True-False-False] 25.3970μs 10.2230μs 97.8188 KOps/s 93.6933 KOps/s $\color{#35bf28}+4.40\%$
test_step_mdp_speed[False-True-False-True-True] 49.3220μs 25.9844μs 38.4847 KOps/s 37.2521 KOps/s $\color{#35bf28}+3.31\%$
test_step_mdp_speed[False-True-False-True-False] 65.2710μs 17.0314μs 58.7149 KOps/s 57.7318 KOps/s $\color{#35bf28}+1.70\%$
test_step_mdp_speed[False-True-False-False-True] 51.1740μs 17.2716μs 57.8984 KOps/s 56.9930 KOps/s $\color{#35bf28}+1.59\%$
test_step_mdp_speed[False-True-False-False-False] 38.9420μs 11.3293μs 88.2670 KOps/s 85.9934 KOps/s $\color{#35bf28}+2.64\%$
test_step_mdp_speed[False-False-True-True-True] 74.9380μs 26.9826μs 37.0610 KOps/s 36.5757 KOps/s $\color{#35bf28}+1.33\%$
test_step_mdp_speed[False-False-True-True-False] 44.3220μs 18.1576μs 55.0735 KOps/s 53.6061 KOps/s $\color{#35bf28}+2.74\%$
test_step_mdp_speed[False-False-True-False-True] 57.8470μs 17.3570μs 57.6135 KOps/s 57.3893 KOps/s $\color{#35bf28}+0.39\%$
test_step_mdp_speed[False-False-True-False-False] 34.0130μs 11.4327μs 87.4683 KOps/s 86.1591 KOps/s $\color{#35bf28}+1.52\%$
test_step_mdp_speed[False-False-False-True-True] 67.0940μs 27.8615μs 35.8918 KOps/s 35.6756 KOps/s $\color{#35bf28}+0.61\%$
test_step_mdp_speed[False-False-False-True-False] 47.1880μs 19.3631μs 51.6447 KOps/s 51.1860 KOps/s $\color{#35bf28}+0.90\%$
test_step_mdp_speed[False-False-False-False-True] 48.6000μs 18.6908μs 53.5022 KOps/s 53.9668 KOps/s $\color{#d91a1a}-0.86\%$
test_step_mdp_speed[False-False-False-False-False] 57.4570μs 12.6094μs 79.3057 KOps/s 78.1979 KOps/s $\color{#35bf28}+1.42\%$
test_values[generalized_advantage_estimate-True-True] 9.6546ms 9.4016ms 106.3652 Ops/s 109.1872 Ops/s $\color{#d91a1a}-2.58\%$
test_values[vec_generalized_advantage_estimate-True-True] 38.9008ms 35.5671ms 28.1159 Ops/s 29.9072 Ops/s $\textbf{\color{#d91a1a}-5.99\%}$
test_values[td0_return_estimate-False-False] 0.2195ms 0.1880ms 5.3183 KOps/s 5.9959 KOps/s $\textbf{\color{#d91a1a}-11.30\%}$
test_values[td1_return_estimate-False-False] 26.8212ms 23.6733ms 42.2417 Ops/s 43.5171 Ops/s $\color{#d91a1a}-2.93\%$
test_values[vec_td1_return_estimate-False-False] 37.8507ms 35.6123ms 28.0802 Ops/s 29.8297 Ops/s $\textbf{\color{#d91a1a}-5.86\%}$
test_values[td_lambda_return_estimate-True-False] 34.4349ms 34.0656ms 29.3551 Ops/s 30.0873 Ops/s $\color{#d91a1a}-2.43\%$
test_values[vec_td_lambda_return_estimate-True-False] 37.3851ms 35.5848ms 28.1019 Ops/s 29.8704 Ops/s $\textbf{\color{#d91a1a}-5.92\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 11.3825ms 8.3441ms 119.8452 Ops/s 123.9909 Ops/s $\color{#d91a1a}-3.34\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.3913ms 2.0144ms 496.4150 Ops/s 501.4046 Ops/s $\color{#d91a1a}-1.00\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4619ms 0.3510ms 2.8486 KOps/s 2.8316 KOps/s $\color{#35bf28}+0.60\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 50.9250ms 47.8178ms 20.9127 Ops/s 24.7794 Ops/s $\textbf{\color{#d91a1a}-15.60\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.8284ms 3.0483ms 328.0478 Ops/s 330.5580 Ops/s $\color{#d91a1a}-0.76\%$
test_dqn_speed 7.0153ms 1.3387ms 746.9856 Ops/s 728.6621 Ops/s $\color{#35bf28}+2.51\%$
test_ddpg_speed 3.6517ms 2.8241ms 354.1002 Ops/s 349.6922 Ops/s $\color{#35bf28}+1.26\%$
test_sac_speed 9.4715ms 8.4639ms 118.1495 Ops/s 108.7142 Ops/s $\textbf{\color{#35bf28}+8.68\%}$
test_redq_speed 99.1875ms 14.4256ms 69.3212 Ops/s 75.8320 Ops/s $\textbf{\color{#d91a1a}-8.59\%}$
test_redq_deprec_speed 15.4649ms 13.5242ms 73.9416 Ops/s 75.9495 Ops/s $\color{#d91a1a}-2.64\%$
test_td3_speed 8.7111ms 8.3548ms 119.6913 Ops/s 118.3473 Ops/s $\color{#35bf28}+1.14\%$
test_cql_speed 38.3581ms 36.5635ms 27.3497 Ops/s 27.4405 Ops/s $\color{#d91a1a}-0.33\%$
test_a2c_speed 10.2775ms 7.6715ms 130.3522 Ops/s 134.3597 Ops/s $\color{#d91a1a}-2.98\%$
test_ppo_speed 8.9971ms 7.6959ms 129.9390 Ops/s 130.1548 Ops/s $\color{#d91a1a}-0.17\%$
test_reinforce_speed 7.5122ms 6.5853ms 151.8535 Ops/s 150.8551 Ops/s $\color{#35bf28}+0.66\%$
test_iql_speed 34.6855ms 33.3356ms 29.9979 Ops/s 30.4357 Ops/s $\color{#d91a1a}-1.44\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.2843ms 2.0702ms 483.0478 Ops/s 470.3265 Ops/s $\color{#35bf28}+2.70\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8864ms 0.4852ms 2.0611 KOps/s 2.0354 KOps/s $\color{#35bf28}+1.26\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7920ms 0.4643ms 2.1538 KOps/s 2.1277 KOps/s $\color{#35bf28}+1.22\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.5023ms 2.1820ms 458.2862 Ops/s 472.5586 Ops/s $\color{#d91a1a}-3.02\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0053ms 0.4795ms 2.0853 KOps/s 2.0508 KOps/s $\color{#35bf28}+1.69\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6274ms 0.4538ms 2.2036 KOps/s 2.1346 KOps/s $\color{#35bf28}+3.23\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.7461ms 1.2200ms 819.6857 Ops/s 799.3488 Ops/s $\color{#35bf28}+2.54\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.8057ms 1.1613ms 861.1098 Ops/s 808.0226 Ops/s $\textbf{\color{#35bf28}+6.57\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.3446ms 2.2571ms 443.0406 Ops/s 431.9242 Ops/s $\color{#35bf28}+2.57\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1505ms 0.6057ms 1.6511 KOps/s 1.6357 KOps/s $\color{#35bf28}+0.94\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7035ms 0.5712ms 1.7508 KOps/s 1.7052 KOps/s $\color{#35bf28}+2.67\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.1965ms 2.0330ms 491.8797 Ops/s 461.3228 Ops/s $\textbf{\color{#35bf28}+6.62\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9376ms 0.4875ms 2.0514 KOps/s 2.0297 KOps/s $\color{#35bf28}+1.07\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6091ms 0.4601ms 2.1733 KOps/s 2.0856 KOps/s $\color{#35bf28}+4.20\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.5007ms 2.1387ms 467.5658 Ops/s 430.8969 Ops/s $\textbf{\color{#35bf28}+8.51\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.1958ms 0.4900ms 2.0409 KOps/s 2.0254 KOps/s $\color{#35bf28}+0.76\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 3.5328ms 0.4704ms 2.1257 KOps/s 2.0865 KOps/s $\color{#35bf28}+1.88\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.2829ms 2.1867ms 457.3030 Ops/s 420.0072 Ops/s $\textbf{\color{#35bf28}+8.88\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1310ms 0.6053ms 1.6520 KOps/s 1.6051 KOps/s $\color{#35bf28}+2.92\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8416ms 0.5809ms 1.7214 KOps/s 1.6795 KOps/s $\color{#35bf28}+2.50\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1154s 7.9148ms 126.3459 Ops/s 122.6712 Ops/s $\color{#35bf28}+3.00\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 14.0582ms 11.9729ms 83.5217 Ops/s 83.0135 Ops/s $\color{#35bf28}+0.61\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.7773ms 1.0960ms 912.3715 Ops/s 948.6417 Ops/s $\color{#d91a1a}-3.82\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1015s 5.6048ms 178.4175 Ops/s 172.9125 Ops/s $\color{#35bf28}+3.18\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 20.0948ms 12.1865ms 82.0583 Ops/s 82.8566 Ops/s $\color{#d91a1a}-0.96\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.7411ms 1.0727ms 932.2183 Ops/s 927.6497 Ops/s $\color{#35bf28}+0.49\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1059s 6.0536ms 165.1916 Ops/s 117.0772 Ops/s $\textbf{\color{#35bf28}+41.10\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 18.5622ms 12.4016ms 80.6348 Ops/s 80.1151 Ops/s $\color{#35bf28}+0.65\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 4.0599ms 1.4309ms 698.8441 Ops/s 723.4301 Ops/s $\color{#d91a1a}-3.40\%$

@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 25, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}8$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1038s 0.1022s 9.7820 Ops/s 9.9053 Ops/s $\color{#d91a1a}-1.24\%$
test_sync 89.5757ms 87.7259ms 11.3991 Ops/s 11.4828 Ops/s $\color{#d91a1a}-0.73\%$
test_async 0.1753s 87.1231ms 11.4780 Ops/s 13.8293 Ops/s $\textbf{\color{#d91a1a}-17.00\%}$
test_single_pixels 0.1141s 0.1118s 8.9480 Ops/s 8.9993 Ops/s $\color{#d91a1a}-0.57\%$
test_sync_pixels 0.1269s 70.2568ms 14.2335 Ops/s 14.2717 Ops/s $\color{#d91a1a}-0.27\%$
test_async_pixels 0.1241s 61.9991ms 16.1293 Ops/s 16.1102 Ops/s $\color{#35bf28}+0.12\%$
test_simple 0.6707s 0.6702s 1.4921 Ops/s 1.4492 Ops/s $\color{#35bf28}+2.96\%$
test_transformed 0.9574s 0.9016s 1.1091 Ops/s 1.0975 Ops/s $\color{#35bf28}+1.06\%$
test_serial 2.1345s 2.0781s 0.4812 Ops/s 0.4751 Ops/s $\color{#35bf28}+1.29\%$
test_parallel 1.8287s 1.7752s 0.5633 Ops/s 0.5555 Ops/s $\color{#35bf28}+1.40\%$
test_step_mdp_speed[True-True-True-True-True] 72.6610μs 32.6042μs 30.6709 KOps/s 30.3424 KOps/s $\color{#35bf28}+1.08\%$
test_step_mdp_speed[True-True-True-True-False] 35.7710μs 19.6251μs 50.9552 KOps/s 50.9474 KOps/s $\color{#35bf28}+0.02\%$
test_step_mdp_speed[True-True-True-False-True] 45.0610μs 18.8187μs 53.1388 KOps/s 53.6010 KOps/s $\color{#d91a1a}-0.86\%$
test_step_mdp_speed[True-True-True-False-False] 27.9710μs 11.3249μs 88.3007 KOps/s 88.2759 KOps/s $\color{#35bf28}+0.03\%$
test_step_mdp_speed[True-True-False-True-True] 53.2700μs 34.7465μs 28.7799 KOps/s 28.7893 KOps/s $\color{#d91a1a}-0.03\%$
test_step_mdp_speed[True-True-False-True-False] 37.1610μs 21.3940μs 46.7420 KOps/s 47.3557 KOps/s $\color{#d91a1a}-1.30\%$
test_step_mdp_speed[True-True-False-False-True] 54.9710μs 20.7922μs 48.0949 KOps/s 48.4427 KOps/s $\color{#d91a1a}-0.72\%$
test_step_mdp_speed[True-True-False-False-False] 77.4310μs 13.1824μs 75.8588 KOps/s 76.3950 KOps/s $\color{#d91a1a}-0.70\%$
test_step_mdp_speed[True-False-True-True-True] 69.4210μs 36.4437μs 27.4396 KOps/s 27.3189 KOps/s $\color{#35bf28}+0.44\%$
test_step_mdp_speed[True-False-True-True-False] 39.8710μs 23.3673μs 42.7948 KOps/s 42.7383 KOps/s $\color{#35bf28}+0.13\%$
test_step_mdp_speed[True-False-True-False-True] 36.3410μs 20.5248μs 48.7216 KOps/s 48.7137 KOps/s $\color{#35bf28}+0.02\%$
test_step_mdp_speed[True-False-True-False-False] 35.0810μs 13.1383μs 76.1133 KOps/s 77.0389 KOps/s $\color{#d91a1a}-1.20\%$
test_step_mdp_speed[True-False-False-True-True] 73.4620μs 37.6080μs 26.5901 KOps/s 25.1496 KOps/s $\textbf{\color{#35bf28}+5.73\%}$
test_step_mdp_speed[True-False-False-True-False] 82.3410μs 25.2568μs 39.5933 KOps/s 37.8668 KOps/s $\color{#35bf28}+4.56\%$
test_step_mdp_speed[True-False-False-False-True] 85.5920μs 22.0625μs 45.3259 KOps/s 43.2387 KOps/s $\color{#35bf28}+4.83\%$
test_step_mdp_speed[True-False-False-False-False] 33.8700μs 14.9208μs 67.0207 KOps/s 63.4585 KOps/s $\textbf{\color{#35bf28}+5.61\%}$
test_step_mdp_speed[False-True-True-True-True] 63.2110μs 36.6991μs 27.2486 KOps/s 26.5900 KOps/s $\color{#35bf28}+2.48\%$
test_step_mdp_speed[False-True-True-True-False] 59.7410μs 23.4375μs 42.6667 KOps/s 41.2268 KOps/s $\color{#35bf28}+3.49\%$
test_step_mdp_speed[False-True-True-False-True] 39.1910μs 23.8610μs 41.9094 KOps/s 39.0776 KOps/s $\textbf{\color{#35bf28}+7.25\%}$
test_step_mdp_speed[False-True-True-False-False] 34.0300μs 15.0886μs 66.2750 KOps/s 62.7105 KOps/s $\textbf{\color{#35bf28}+5.68\%}$
test_step_mdp_speed[False-True-False-True-True] 59.8810μs 38.5638μs 25.9311 KOps/s 24.6341 KOps/s $\textbf{\color{#35bf28}+5.26\%}$
test_step_mdp_speed[False-True-False-True-False] 47.4610μs 25.3024μs 39.5219 KOps/s 37.3802 KOps/s $\textbf{\color{#35bf28}+5.73\%}$
test_step_mdp_speed[False-True-False-False-True] 43.5110μs 25.8141μs 38.7386 KOps/s 36.4098 KOps/s $\textbf{\color{#35bf28}+6.40\%}$
test_step_mdp_speed[False-True-False-False-False] 35.6810μs 16.8577μs 59.3201 KOps/s 59.4387 KOps/s $\color{#d91a1a}-0.20\%$
test_step_mdp_speed[False-False-True-True-True] 80.4110μs 40.3212μs 24.8008 KOps/s 24.8592 KOps/s $\color{#d91a1a}-0.24\%$
test_step_mdp_speed[False-False-True-True-False] 49.1610μs 27.3563μs 36.5547 KOps/s 36.9907 KOps/s $\color{#d91a1a}-1.18\%$
test_step_mdp_speed[False-False-True-False-True] 44.5610μs 26.1496μs 38.2416 KOps/s 38.0132 KOps/s $\color{#35bf28}+0.60\%$
test_step_mdp_speed[False-False-True-False-False] 33.8100μs 16.9978μs 58.8313 KOps/s 56.6664 KOps/s $\color{#35bf28}+3.82\%$
test_step_mdp_speed[False-False-False-True-True] 62.2410μs 41.7174μs 23.9708 KOps/s 24.0608 KOps/s $\color{#d91a1a}-0.37\%$
test_step_mdp_speed[False-False-False-True-False] 60.8110μs 29.3090μs 34.1193 KOps/s 34.1216 KOps/s $-0.01\%$
test_step_mdp_speed[False-False-False-False-True] 47.9500μs 27.9606μs 35.7646 KOps/s 35.7260 KOps/s $\color{#35bf28}+0.11\%$
test_step_mdp_speed[False-False-False-False-False] 41.2010μs 18.3266μs 54.5654 KOps/s 54.7215 KOps/s $\color{#d91a1a}-0.29\%$
test_values[generalized_advantage_estimate-True-True] 25.1349ms 24.5701ms 40.6999 Ops/s 40.1648 Ops/s $\color{#35bf28}+1.33\%$
test_values[vec_generalized_advantage_estimate-True-True] 79.5861ms 3.1614ms 316.3146 Ops/s 315.0537 Ops/s $\color{#35bf28}+0.40\%$
test_values[td0_return_estimate-False-False] 92.3320μs 65.0636μs 15.3696 KOps/s 15.6911 KOps/s $\color{#d91a1a}-2.05\%$
test_values[td1_return_estimate-False-False] 57.0337ms 56.5026ms 17.6983 Ops/s 19.0201 Ops/s $\textbf{\color{#d91a1a}-6.95\%}$
test_values[vec_td1_return_estimate-False-False] 2.1049ms 1.7728ms 564.0914 Ops/s 567.3626 Ops/s $\color{#d91a1a}-0.58\%$
test_values[td_lambda_return_estimate-True-False] 90.6311ms 90.1687ms 11.0903 Ops/s 11.7648 Ops/s $\textbf{\color{#d91a1a}-5.73\%}$
test_values[vec_td_lambda_return_estimate-True-False] 2.1271ms 1.7660ms 566.2661 Ops/s 567.6963 Ops/s $\color{#d91a1a}-0.25\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 25.5438ms 23.8219ms 41.9782 Ops/s 43.5272 Ops/s $\color{#d91a1a}-3.56\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.9032ms 0.7055ms 1.4175 KOps/s 1.4381 KOps/s $\color{#d91a1a}-1.43\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7004ms 0.6522ms 1.5332 KOps/s 1.5449 KOps/s $\color{#d91a1a}-0.76\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5315ms 1.4697ms 680.4215 Ops/s 688.7088 Ops/s $\color{#d91a1a}-1.20\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9538ms 0.6729ms 1.4862 KOps/s 1.4947 KOps/s $\color{#d91a1a}-0.57\%$
test_dqn_speed 2.1618ms 1.4269ms 700.8122 Ops/s 685.7687 Ops/s $\color{#35bf28}+2.19\%$
test_ddpg_speed 3.2731ms 2.9316ms 341.1122 Ops/s 336.2309 Ops/s $\color{#35bf28}+1.45\%$
test_sac_speed 8.8958ms 8.4057ms 118.9668 Ops/s 116.4987 Ops/s $\color{#35bf28}+2.12\%$
test_redq_speed 10.9378ms 10.1715ms 98.3137 Ops/s 95.5289 Ops/s $\color{#35bf28}+2.92\%$
test_redq_deprec_speed 12.0170ms 11.4310ms 87.4811 Ops/s 87.2454 Ops/s $\color{#35bf28}+0.27\%$
test_td3_speed 8.5702ms 8.3930ms 119.1469 Ops/s 116.7327 Ops/s $\color{#35bf28}+2.07\%$
test_cql_speed 26.1416ms 25.3975ms 39.3739 Ops/s 38.1268 Ops/s $\color{#35bf28}+3.27\%$
test_a2c_speed 6.2969ms 5.6112ms 178.2136 Ops/s 174.5406 Ops/s $\color{#35bf28}+2.10\%$
test_ppo_speed 6.4618ms 5.8828ms 169.9857 Ops/s 165.4319 Ops/s $\color{#35bf28}+2.75\%$
test_reinforce_speed 5.6146ms 4.6587ms 214.6515 Ops/s 214.4026 Ops/s $\color{#35bf28}+0.12\%$
test_iql_speed 20.2831ms 19.7447ms 50.6465 Ops/s 49.6797 Ops/s $\color{#35bf28}+1.95\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.9805ms 2.7695ms 361.0812 Ops/s 358.6471 Ops/s $\color{#35bf28}+0.68\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.1001s 0.6012ms 1.6633 KOps/s 1.8525 KOps/s $\textbf{\color{#d91a1a}-10.21\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6946ms 0.5087ms 1.9659 KOps/s 1.9293 KOps/s $\color{#35bf28}+1.90\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0856ms 2.8090ms 356.0029 Ops/s 357.7743 Ops/s $\color{#d91a1a}-0.50\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7492ms 0.5236ms 1.9097 KOps/s 1.8885 KOps/s $\color{#35bf28}+1.12\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 4.1219ms 0.5084ms 1.9668 KOps/s 1.9572 KOps/s $\color{#35bf28}+0.49\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.5477ms 1.4156ms 706.3919 Ops/s 683.6796 Ops/s $\color{#35bf28}+3.32\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5423ms 1.3490ms 741.2864 Ops/s 716.7708 Ops/s $\color{#35bf28}+3.42\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.1344ms 2.9215ms 342.2912 Ops/s 345.0854 Ops/s $\color{#d91a1a}-0.81\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.3222ms 0.6538ms 1.5295 KOps/s 1.5226 KOps/s $\color{#35bf28}+0.45\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8431ms 0.6335ms 1.5785 KOps/s 1.5575 KOps/s $\color{#35bf28}+1.35\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.0160ms 2.8046ms 356.5512 Ops/s 359.7637 Ops/s $\color{#d91a1a}-0.89\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6762ms 0.5306ms 1.8848 KOps/s 1.8484 KOps/s $\color{#35bf28}+1.97\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7382ms 0.5136ms 1.9469 KOps/s 1.9146 KOps/s $\color{#35bf28}+1.69\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0886ms 2.8168ms 355.0164 Ops/s 356.9073 Ops/s $\color{#d91a1a}-0.53\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6391ms 0.5243ms 1.9074 KOps/s 1.8842 KOps/s $\color{#35bf28}+1.23\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7184ms 0.5037ms 1.9853 KOps/s 1.9562 KOps/s $\color{#35bf28}+1.49\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0063ms 2.9371ms 340.4725 Ops/s 344.4613 Ops/s $\color{#d91a1a}-1.16\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.4807ms 0.6567ms 1.5227 KOps/s 1.5203 KOps/s $\color{#35bf28}+0.16\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8469ms 0.6388ms 1.5654 KOps/s 1.5478 KOps/s $\color{#35bf28}+1.14\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1295s 9.6117ms 104.0394 Ops/s 105.5538 Ops/s $\color{#d91a1a}-1.43\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.2662ms 14.8902ms 67.1582 Ops/s 67.5259 Ops/s $\color{#d91a1a}-0.54\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 7.1038ms 1.3216ms 756.6767 Ops/s 889.3209 Ops/s $\textbf{\color{#d91a1a}-14.92\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1168s 7.0924ms 140.9966 Ops/s 140.1317 Ops/s $\color{#35bf28}+0.62\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.2972ms 14.9564ms 66.8608 Ops/s 67.9793 Ops/s $\color{#d91a1a}-1.65\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 6.8062ms 1.2941ms 772.7439 Ops/s 886.7721 Ops/s $\textbf{\color{#d91a1a}-12.86\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1172s 7.4500ms 134.2276 Ops/s 101.9657 Ops/s $\textbf{\color{#35bf28}+31.64\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.3302ms 15.1040ms 66.2077 Ops/s 66.0017 Ops/s $\color{#35bf28}+0.31\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.7039ms 1.5178ms 658.8671 Ops/s 682.7762 Ops/s $\color{#d91a1a}-3.50\%$

@vmoens vmoens added the versioning Versioning change (version number etc) label Apr 25, 2024
vmoens
vmoens commented Apr 25, 2024
View reviewed changes
setup.py Outdated Show resolved Hide resolved
@vmoens vmoens merged commit 9a9fa5b into main Apr 25, 2024
36 of 43 checks passed
@vmoens vmoens deleted the new-torch-version branch April 25, 2024 12:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. versioning Versioning change (version number etc)
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot