Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Doc] Fix tutos #1863

Merged
merged 9 commits into from
Feb 2, 2024
Merged

[Doc] Fix tutos #1863

merged 9 commits into from
Feb 2, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Feb 1, 2024 •
edited
Loading

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Feb 1, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/1863

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (20 Unrelated Failures)

As of commit 3cd8479 with merge base 01a2216 (image):

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Feb 1, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 1, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1311s 65.8554ms 15.1848 Ops/s 15.9870 Ops/s $\textbf{\color{#d91a1a}-5.02\%}$
test_sync 35.4705ms 33.4315ms 29.9119 Ops/s 29.7204 Ops/s $\color{#35bf28}+0.64\%$
test_async 0.1084s 32.5011ms 30.7682 Ops/s 30.3190 Ops/s $\color{#35bf28}+1.48\%$
test_simple 0.4904s 0.4290s 2.3309 Ops/s 2.3235 Ops/s $\color{#35bf28}+0.32\%$
test_transformed 0.6444s 0.5892s 1.6971 Ops/s 1.6816 Ops/s $\color{#35bf28}+0.92\%$
test_serial 1.3915s 1.3418s 0.7453 Ops/s 0.7386 Ops/s $\color{#35bf28}+0.91\%$
test_parallel 1.2386s 1.1758s 0.8505 Ops/s 0.8490 Ops/s $\color{#35bf28}+0.18\%$
test_step_mdp_speed[True-True-True-True-True] 0.1256ms 21.3526μs 46.8328 KOps/s 47.3447 KOps/s $\color{#d91a1a}-1.08\%$
test_step_mdp_speed[True-True-True-True-False] 36.0170μs 13.0715μs 76.5023 KOps/s 78.3023 KOps/s $\color{#d91a1a}-2.30\%$
test_step_mdp_speed[True-True-True-False-True] 36.5480μs 12.4629μs 80.2384 KOps/s 82.1228 KOps/s $\color{#d91a1a}-2.29\%$
test_step_mdp_speed[True-True-True-False-False] 25.6980μs 7.6279μs 131.0978 KOps/s 134.6430 KOps/s $\color{#d91a1a}-2.63\%$
test_step_mdp_speed[True-True-False-True-True] 70.8680μs 22.4097μs 44.6235 KOps/s 45.0688 KOps/s $\color{#d91a1a}-0.99\%$
test_step_mdp_speed[True-True-False-True-False] 45.5950μs 14.4232μs 69.3329 KOps/s 71.1818 KOps/s $\color{#d91a1a}-2.60\%$
test_step_mdp_speed[True-True-False-False-True] 35.6470μs 13.6740μs 73.1315 KOps/s 73.9584 KOps/s $\color{#d91a1a}-1.12\%$
test_step_mdp_speed[True-True-False-False-False] 51.6700μs 8.8447μs 113.0615 KOps/s 115.5906 KOps/s $\color{#d91a1a}-2.19\%$
test_step_mdp_speed[True-False-True-True-True] 53.2190μs 23.9911μs 41.6822 KOps/s 42.3077 KOps/s $\color{#d91a1a}-1.48\%$
test_step_mdp_speed[True-False-True-True-False] 46.7770μs 15.6053μs 64.0808 KOps/s 65.5392 KOps/s $\color{#d91a1a}-2.23\%$
test_step_mdp_speed[True-False-True-False-True] 42.4890μs 13.6177μs 73.4338 KOps/s 74.5470 KOps/s $\color{#d91a1a}-1.49\%$
test_step_mdp_speed[True-False-True-False-False] 39.6430μs 8.8550μs 112.9309 KOps/s 115.7266 KOps/s $\color{#d91a1a}-2.42\%$
test_step_mdp_speed[True-False-False-True-True] 56.1740μs 24.9321μs 40.1090 KOps/s 40.1946 KOps/s $\color{#d91a1a}-0.21\%$
test_step_mdp_speed[True-False-False-True-False] 42.0190μs 16.8512μs 59.3431 KOps/s 60.5798 KOps/s $\color{#d91a1a}-2.04\%$
test_step_mdp_speed[True-False-False-False-True] 43.7720μs 14.7968μs 67.5820 KOps/s 67.9534 KOps/s $\color{#d91a1a}-0.55\%$
test_step_mdp_speed[True-False-False-False-False] 34.6240μs 10.1534μs 98.4892 KOps/s 102.0938 KOps/s $\color{#d91a1a}-3.53\%$
test_step_mdp_speed[False-True-True-True-True] 50.6150μs 24.1498μs 41.4082 KOps/s 42.0203 KOps/s $\color{#d91a1a}-1.46\%$
test_step_mdp_speed[False-True-True-True-False] 42.2390μs 15.7745μs 63.3934 KOps/s 64.6587 KOps/s $\color{#d91a1a}-1.96\%$
test_step_mdp_speed[False-True-True-False-True] 48.6100μs 15.9467μs 62.7090 KOps/s 63.6534 KOps/s $\color{#d91a1a}-1.48\%$
test_step_mdp_speed[False-True-True-False-False] 41.5970μs 9.9497μs 100.5053 KOps/s 101.3403 KOps/s $\color{#d91a1a}-0.82\%$
test_step_mdp_speed[False-True-False-True-True] 62.7970μs 25.1397μs 39.7778 KOps/s 40.1770 KOps/s $\color{#d91a1a}-0.99\%$
test_step_mdp_speed[False-True-False-True-False] 50.3140μs 16.9696μs 58.9290 KOps/s 60.3408 KOps/s $\color{#d91a1a}-2.34\%$
test_step_mdp_speed[False-True-False-False-True] 42.5690μs 17.0982μs 58.4858 KOps/s 59.2452 KOps/s $\color{#d91a1a}-1.28\%$
test_step_mdp_speed[False-True-False-False-False] 46.8570μs 11.2852μs 88.6114 KOps/s 90.9671 KOps/s $\color{#d91a1a}-2.59\%$
test_step_mdp_speed[False-False-True-True-True] 60.1720μs 26.3940μs 37.8874 KOps/s 37.6324 KOps/s $\color{#35bf28}+0.68\%$
test_step_mdp_speed[False-False-True-True-False] 47.5080μs 18.4516μs 54.1959 KOps/s 55.6012 KOps/s $\color{#d91a1a}-2.53\%$
test_step_mdp_speed[False-False-True-False-True] 41.3870μs 17.2620μs 57.9306 KOps/s 58.5125 KOps/s $\color{#d91a1a}-0.99\%$
test_step_mdp_speed[False-False-True-False-False] 45.5340μs 11.3042μs 88.4629 KOps/s 90.5823 KOps/s $\color{#d91a1a}-2.34\%$
test_step_mdp_speed[False-False-False-True-True] 65.2620μs 27.2653μs 36.6766 KOps/s 36.5311 KOps/s $\color{#35bf28}+0.40\%$
test_step_mdp_speed[False-False-False-True-False] 65.4080μs 19.3015μs 51.8096 KOps/s 52.1073 KOps/s $\color{#d91a1a}-0.57\%$
test_step_mdp_speed[False-False-False-False-True] 43.0100μs 17.9292μs 55.7750 KOps/s 55.5641 KOps/s $\color{#35bf28}+0.38\%$
test_step_mdp_speed[False-False-False-False-False] 43.0000μs 12.3435μs 81.0144 KOps/s 82.4549 KOps/s $\color{#d91a1a}-1.75\%$
test_values[generalized_advantage_estimate-True-True] 9.6238ms 9.3566ms 106.8760 Ops/s 108.0323 Ops/s $\color{#d91a1a}-1.07\%$
test_values[vec_generalized_advantage_estimate-True-True] 37.0014ms 35.6762ms 28.0299 Ops/s 27.7551 Ops/s $\color{#35bf28}+0.99\%$
test_values[td0_return_estimate-False-False] 0.2224ms 0.1624ms 6.1594 KOps/s 6.0768 KOps/s $\color{#35bf28}+1.36\%$
test_values[td1_return_estimate-False-False] 23.8045ms 23.1047ms 43.2813 Ops/s 42.4395 Ops/s $\color{#35bf28}+1.98\%$
test_values[vec_td1_return_estimate-False-False] 36.7525ms 35.3959ms 28.2518 Ops/s 27.8967 Ops/s $\color{#35bf28}+1.27\%$
test_values[td_lambda_return_estimate-True-False] 33.3511ms 33.0312ms 30.2744 Ops/s 29.3084 Ops/s $\color{#35bf28}+3.30\%$
test_values[vec_td_lambda_return_estimate-True-False] 37.1624ms 35.3691ms 28.2732 Ops/s 27.9932 Ops/s $\color{#35bf28}+1.00\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.2272ms 8.0588ms 124.0882 Ops/s 123.1818 Ops/s $\color{#35bf28}+0.74\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.2861ms 2.0247ms 493.8962 Ops/s 502.4649 Ops/s $\color{#d91a1a}-1.71\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4210ms 0.3440ms 2.9068 KOps/s 2.8290 KOps/s $\color{#35bf28}+2.75\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 52.2775ms 49.5556ms 20.1793 Ops/s 20.1567 Ops/s $\color{#35bf28}+0.11\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.5268ms 3.0113ms 332.0818 Ops/s 332.0587 Ops/s $+0.01\%$
test_dqn_speed 6.0936ms 5.8290ms 171.5559 Ops/s 170.2183 Ops/s $\color{#35bf28}+0.79\%$
test_ddpg_speed 12.6424ms 11.3665ms 87.9779 Ops/s 81.9830 Ops/s $\textbf{\color{#35bf28}+7.31\%}$
test_sac_speed 23.4821ms 22.8997ms 43.6686 Ops/s 43.2442 Ops/s $\color{#35bf28}+0.98\%$
test_redq_speed 15.1967ms 13.9830ms 71.5155 Ops/s 71.9107 Ops/s $\color{#d91a1a}-0.55\%$
test_redq_deprec_speed 23.4662ms 21.1679ms 47.2412 Ops/s 46.8252 Ops/s $\color{#35bf28}+0.89\%$
test_td3_speed 24.1564ms 16.0404ms 62.3426 Ops/s 61.8407 Ops/s $\color{#35bf28}+0.81\%$
test_cql_speed 74.0999ms 72.7332ms 13.7489 Ops/s 13.5917 Ops/s $\color{#35bf28}+1.16\%$
test_a2c_speed 23.8059ms 21.6229ms 46.2473 Ops/s 46.4081 Ops/s $\color{#d91a1a}-0.35\%$
test_ppo_speed 22.5951ms 21.7321ms 46.0148 Ops/s 45.9932 Ops/s $\color{#35bf28}+0.05\%$
test_reinforce_speed 21.6434ms 20.6999ms 48.3094 Ops/s 48.0920 Ops/s $\color{#35bf28}+0.45\%$
test_iql_speed 55.6919ms 54.5522ms 18.3311 Ops/s 18.1538 Ops/s $\color{#35bf28}+0.98\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.0395ms 2.6549ms 376.6626 Ops/s 381.6379 Ops/s $\color{#d91a1a}-1.30\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7080ms 0.5019ms 1.9923 KOps/s 1.9944 KOps/s $\color{#d91a1a}-0.11\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7237ms 0.4753ms 2.1037 KOps/s 2.1010 KOps/s $\color{#35bf28}+0.13\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.2780ms 2.5640ms 390.0095 Ops/s 379.2058 Ops/s $\color{#35bf28}+2.85\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7471ms 0.5025ms 1.9900 KOps/s 2.0099 KOps/s $\color{#d91a1a}-0.99\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6455ms 0.4731ms 2.1135 KOps/s 2.1294 KOps/s $\color{#d91a1a}-0.74\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.5436ms 2.3567ms 424.3295 Ops/s 422.9047 Ops/s $\color{#35bf28}+0.34\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0146ms 0.6207ms 1.6112 KOps/s 1.6212 KOps/s $\color{#d91a1a}-0.62\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7793ms 0.5870ms 1.7036 KOps/s 1.6968 KOps/s $\color{#35bf28}+0.40\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.8224ms 2.5599ms 390.6342 Ops/s 387.2898 Ops/s $\color{#35bf28}+0.86\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7156ms 0.5053ms 1.9790 KOps/s 2.0002 KOps/s $\color{#d91a1a}-1.06\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6641ms 0.4771ms 2.0960 KOps/s 2.1041 KOps/s $\color{#d91a1a}-0.38\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.9571ms 2.5980ms 384.9182 Ops/s 381.6582 Ops/s $\color{#35bf28}+0.85\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7134ms 0.5000ms 2.0000 KOps/s 1.9967 KOps/s $\color{#35bf28}+0.17\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5733ms 0.4698ms 2.1286 KOps/s 2.1096 KOps/s $\color{#35bf28}+0.90\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.8375ms 2.3839ms 419.4792 Ops/s 419.0430 Ops/s $\color{#35bf28}+0.10\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8765ms 0.6219ms 1.6079 KOps/s 1.6249 KOps/s $\color{#d91a1a}-1.05\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7398ms 0.5904ms 1.6939 KOps/s 1.6923 KOps/s $\color{#35bf28}+0.09\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 95.4327ms 7.7845ms 128.4606 Ops/s 124.0872 Ops/s $\color{#35bf28}+3.52\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 15.3547ms 13.1468ms 76.0639 Ops/s 75.7679 Ops/s $\color{#35bf28}+0.39\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 4.9746ms 2.5206ms 396.7236 Ops/s 398.0998 Ops/s $\color{#d91a1a}-0.35\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 95.4346ms 9.4134ms 106.2317 Ops/s 125.9328 Ops/s $\textbf{\color{#d91a1a}-15.64\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 16.0195ms 13.1501ms 76.0451 Ops/s 66.4409 Ops/s $\textbf{\color{#35bf28}+14.46\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 5.0608ms 2.5168ms 397.3292 Ops/s 396.1111 Ops/s $\color{#35bf28}+0.31\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 95.9093ms 7.8610ms 127.2104 Ops/s 121.8872 Ops/s $\color{#35bf28}+4.37\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 18.1348ms 14.5043ms 68.9453 Ops/s 74.6705 Ops/s $\textbf{\color{#d91a1a}-7.67\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 3.6009ms 2.6532ms 376.9013 Ops/s 374.2718 Ops/s $\color{#35bf28}+0.70\%$

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 1, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 92. Improved: $\large\color{#35bf28}8$. Worsened: $\large\color{#d91a1a}1$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1222s 0.1199s 8.3411 Ops/s 8.2827 Ops/s $\color{#35bf28}+0.70\%$
test_sync 0.1404s 0.1387s 7.2084 Ops/s 7.1153 Ops/s $\color{#35bf28}+1.31\%$
test_async 0.3398s 0.1347s 7.4218 Ops/s 7.4480 Ops/s $\color{#d91a1a}-0.35\%$
test_single_pixels 0.1300s 0.1298s 7.7031 Ops/s 7.0378 Ops/s $\textbf{\color{#35bf28}+9.45\%}$
test_sync_pixels 0.1097s 0.1079s 9.2644 Ops/s 9.3562 Ops/s $\color{#d91a1a}-0.98\%$
test_async_pixels 0.1957s 96.1874ms 10.3964 Ops/s 10.0731 Ops/s $\color{#35bf28}+3.21\%$
test_simple 0.9225s 0.8575s 1.1661 Ops/s 1.1682 Ops/s $\color{#d91a1a}-0.18\%$
test_transformed 1.1642s 1.1019s 0.9075 Ops/s 0.8910 Ops/s $\color{#35bf28}+1.85\%$
test_serial 2.3846s 2.3620s 0.4234 Ops/s 0.4155 Ops/s $\color{#35bf28}+1.91\%$
test_parallel 3.2298s 3.1694s 0.3155 Ops/s 0.3111 Ops/s $\color{#35bf28}+1.42\%$
test_step_mdp_speed[True-True-True-True-True] 90.7910μs 32.8669μs 30.4257 KOps/s 29.9599 KOps/s $\color{#35bf28}+1.55\%$
test_step_mdp_speed[True-True-True-True-False] 37.0510μs 19.6755μs 50.8245 KOps/s 50.1894 KOps/s $\color{#35bf28}+1.27\%$
test_step_mdp_speed[True-True-True-False-True] 33.3400μs 18.1332μs 55.1475 KOps/s 52.8309 KOps/s $\color{#35bf28}+4.38\%$
test_step_mdp_speed[True-True-True-False-False] 65.4810μs 10.9395μs 91.4115 KOps/s 88.1558 KOps/s $\color{#35bf28}+3.69\%$
test_step_mdp_speed[True-True-False-True-True] 70.4610μs 34.6945μs 28.8230 KOps/s 28.4315 KOps/s $\color{#35bf28}+1.38\%$
test_step_mdp_speed[True-True-False-True-False] 46.3910μs 21.5138μs 46.4818 KOps/s 46.1537 KOps/s $\color{#35bf28}+0.71\%$
test_step_mdp_speed[True-True-False-False-True] 44.6400μs 20.3843μs 49.0574 KOps/s 48.2627 KOps/s $\color{#35bf28}+1.65\%$
test_step_mdp_speed[True-True-False-False-False] 30.7100μs 13.1792μs 75.8770 KOps/s 75.6963 KOps/s $\color{#35bf28}+0.24\%$
test_step_mdp_speed[True-False-True-True-True] 60.6700μs 36.7799μs 27.1888 KOps/s 27.1055 KOps/s $\color{#35bf28}+0.31\%$
test_step_mdp_speed[True-False-True-True-False] 47.8510μs 23.5627μs 42.4400 KOps/s 42.5404 KOps/s $\color{#d91a1a}-0.24\%$
test_step_mdp_speed[True-False-True-False-True] 41.6700μs 20.3507μs 49.1383 KOps/s 48.1815 KOps/s $\color{#35bf28}+1.99\%$
test_step_mdp_speed[True-False-True-False-False] 38.5800μs 13.1760μs 75.8953 KOps/s 75.7529 KOps/s $\color{#35bf28}+0.19\%$
test_step_mdp_speed[True-False-False-True-True] 60.5510μs 38.2898μs 26.1166 KOps/s 26.1448 KOps/s $\color{#d91a1a}-0.11\%$
test_step_mdp_speed[True-False-False-True-False] 41.0100μs 25.0263μs 39.9579 KOps/s 40.1529 KOps/s $\color{#d91a1a}-0.49\%$
test_step_mdp_speed[True-False-False-False-True] 39.2210μs 22.3028μs 44.8374 KOps/s 44.5543 KOps/s $\color{#35bf28}+0.64\%$
test_step_mdp_speed[True-False-False-False-False] 33.7510μs 14.7259μs 67.9078 KOps/s 66.9558 KOps/s $\color{#35bf28}+1.42\%$
test_step_mdp_speed[False-True-True-True-True] 54.5100μs 36.3659μs 27.4983 KOps/s 26.7283 KOps/s $\color{#35bf28}+2.88\%$
test_step_mdp_speed[False-True-True-True-False] 50.2710μs 23.8551μs 41.9198 KOps/s 42.9963 KOps/s $\color{#d91a1a}-2.50\%$
test_step_mdp_speed[False-True-True-False-True] 39.9110μs 24.4991μs 40.8179 KOps/s 40.9057 KOps/s $\color{#d91a1a}-0.21\%$
test_step_mdp_speed[False-True-True-False-False] 39.0910μs 15.1833μs 65.8616 KOps/s 66.3460 KOps/s $\color{#d91a1a}-0.73\%$
test_step_mdp_speed[False-True-False-True-True] 58.2610μs 38.5414μs 25.9461 KOps/s 25.4883 KOps/s $\color{#35bf28}+1.80\%$
test_step_mdp_speed[False-True-False-True-False] 42.8800μs 25.6060μs 39.0533 KOps/s 39.2754 KOps/s $\color{#d91a1a}-0.57\%$
test_step_mdp_speed[False-True-False-False-True] 59.4410μs 26.4721μs 37.7756 KOps/s 38.4969 KOps/s $\color{#d91a1a}-1.87\%$
test_step_mdp_speed[False-True-False-False-False] 39.6310μs 16.7812μs 59.5906 KOps/s 60.5290 KOps/s $\color{#d91a1a}-1.55\%$
test_step_mdp_speed[False-False-True-True-True] 60.7500μs 39.7564μs 25.1532 KOps/s 24.5775 KOps/s $\color{#35bf28}+2.34\%$
test_step_mdp_speed[False-False-True-True-False] 45.0810μs 27.3139μs 36.6115 KOps/s 36.4103 KOps/s $\color{#35bf28}+0.55\%$
test_step_mdp_speed[False-False-True-False-True] 50.6110μs 25.7957μs 38.7661 KOps/s 37.6005 KOps/s $\color{#35bf28}+3.10\%$
test_step_mdp_speed[False-False-True-False-False] 34.4010μs 16.9696μs 58.9289 KOps/s 59.2437 KOps/s $\color{#d91a1a}-0.53\%$
test_step_mdp_speed[False-False-False-True-True] 67.2100μs 41.7172μs 23.9709 KOps/s 23.8139 KOps/s $\color{#35bf28}+0.66\%$
test_step_mdp_speed[False-False-False-True-False] 47.6110μs 29.1543μs 34.3003 KOps/s 34.6327 KOps/s $\color{#d91a1a}-0.96\%$
test_step_mdp_speed[False-False-False-False-True] 49.9300μs 27.9556μs 35.7710 KOps/s 36.2245 KOps/s $\color{#d91a1a}-1.25\%$
test_step_mdp_speed[False-False-False-False-False] 41.6810μs 18.7655μs 53.2892 KOps/s 52.5509 KOps/s $\color{#35bf28}+1.40\%$
test_values[generalized_advantage_estimate-True-True] 24.9226ms 24.5019ms 40.8132 Ops/s 39.6314 Ops/s $\color{#35bf28}+2.98\%$
test_values[vec_generalized_advantage_estimate-True-True] 85.2632ms 3.2699ms 305.8211 Ops/s 306.7238 Ops/s $\color{#d91a1a}-0.29\%$
test_values[td0_return_estimate-False-False] 0.1013ms 62.0665μs 16.1118 KOps/s 15.9775 KOps/s $\color{#35bf28}+0.84\%$
test_values[td1_return_estimate-False-False] 53.1522ms 52.4055ms 19.0820 Ops/s 18.3586 Ops/s $\color{#35bf28}+3.94\%$
test_values[vec_td1_return_estimate-False-False] 1.9975ms 1.7577ms 568.9204 Ops/s 565.8847 Ops/s $\color{#35bf28}+0.54\%$
test_values[td_lambda_return_estimate-True-False] 85.2032ms 83.7866ms 11.9351 Ops/s 11.0421 Ops/s $\textbf{\color{#35bf28}+8.09\%}$
test_values[vec_td_lambda_return_estimate-True-False] 3.9114ms 1.7939ms 557.4339 Ops/s 553.4069 Ops/s $\color{#35bf28}+0.73\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 23.6351ms 23.3905ms 42.7525 Ops/s 39.0848 Ops/s $\textbf{\color{#35bf28}+9.38\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8707ms 0.6976ms 1.4335 KOps/s 1.4146 KOps/s $\color{#35bf28}+1.34\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7136ms 0.6533ms 1.5307 KOps/s 1.5227 KOps/s $\color{#35bf28}+0.52\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5510ms 1.4515ms 688.9327 Ops/s 685.6533 Ops/s $\color{#35bf28}+0.48\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9339ms 0.6766ms 1.4781 KOps/s 1.4175 KOps/s $\color{#35bf28}+4.27\%$
test_dqn_speed 7.6179ms 7.0521ms 141.8022 Ops/s 139.4805 Ops/s $\color{#35bf28}+1.66\%$
test_ddpg_speed 14.2945ms 13.5497ms 73.8025 Ops/s 72.4616 Ops/s $\color{#35bf28}+1.85\%$
test_sac_speed 28.0441ms 27.3749ms 36.5298 Ops/s 36.0809 Ops/s $\color{#35bf28}+1.24\%$
test_redq_speed 12.3233ms 11.1781ms 89.4605 Ops/s 79.7524 Ops/s $\textbf{\color{#35bf28}+12.17\%}$
test_redq_deprec_speed 22.5646ms 21.7133ms 46.0547 Ops/s 45.1808 Ops/s $\color{#35bf28}+1.93\%$
test_td3_speed 18.7238ms 18.2212ms 54.8811 Ops/s 54.0701 Ops/s $\color{#35bf28}+1.50\%$
test_cql_speed 74.1451ms 72.8612ms 13.7247 Ops/s 13.6131 Ops/s $\color{#35bf28}+0.82\%$
test_a2c_speed 25.1100ms 24.2369ms 41.2593 Ops/s 37.4838 Ops/s $\textbf{\color{#35bf28}+10.07\%}$
test_ppo_speed 25.6479ms 24.3239ms 41.1118 Ops/s 40.7206 Ops/s $\color{#35bf28}+0.96\%$
test_reinforce_speed 23.7072ms 23.2531ms 43.0050 Ops/s 42.6589 Ops/s $\color{#35bf28}+0.81\%$
test_iql_speed 49.4175ms 48.1920ms 20.7503 Ops/s 20.5985 Ops/s $\color{#35bf28}+0.74\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.7634ms 3.5497ms 281.7132 Ops/s 275.5428 Ops/s $\color{#35bf28}+2.24\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6743ms 0.5483ms 1.8238 KOps/s 1.8026 KOps/s $\color{#35bf28}+1.18\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6728ms 0.5225ms 1.9139 KOps/s 1.8976 KOps/s $\color{#35bf28}+0.86\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.7835ms 3.5903ms 278.5311 Ops/s 271.9952 Ops/s $\color{#35bf28}+2.40\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6730ms 0.5467ms 1.8291 KOps/s 1.8239 KOps/s $\color{#35bf28}+0.29\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6409ms 0.5193ms 1.9257 KOps/s 1.9247 KOps/s $\color{#35bf28}+0.05\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.4508ms 3.3022ms 302.8295 Ops/s 301.5857 Ops/s $\color{#35bf28}+0.41\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8013ms 0.6681ms 1.4969 KOps/s 1.4710 KOps/s $\color{#35bf28}+1.76\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8969ms 0.6427ms 1.5559 KOps/s 1.5329 KOps/s $\color{#35bf28}+1.49\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.7079ms 3.5800ms 279.3321 Ops/s 272.9012 Ops/s $\color{#35bf28}+2.36\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8006ms 0.5529ms 1.8086 KOps/s 1.8169 KOps/s $\color{#d91a1a}-0.46\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7550ms 0.5225ms 1.9140 KOps/s 1.8956 KOps/s $\color{#35bf28}+0.97\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.8049ms 3.6164ms 276.5215 Ops/s 272.8314 Ops/s $\color{#35bf28}+1.35\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7176ms 0.5489ms 1.8218 KOps/s 1.8203 KOps/s $\color{#35bf28}+0.08\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7715ms 0.5198ms 1.9240 KOps/s 1.9088 KOps/s $\color{#35bf28}+0.79\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 4.5349ms 3.2656ms 306.2256 Ops/s 301.7203 Ops/s $\color{#35bf28}+1.49\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8120ms 0.6727ms 1.4865 KOps/s 1.4771 KOps/s $\color{#35bf28}+0.63\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8443ms 0.6421ms 1.5575 KOps/s 1.5431 KOps/s $\color{#35bf28}+0.93\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1313s 10.2354ms 97.7004 Ops/s 96.0054 Ops/s $\color{#35bf28}+1.77\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 18.2949ms 15.7809ms 63.3678 Ops/s 60.0754 Ops/s $\textbf{\color{#35bf28}+5.48\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 6.2369ms 3.0245ms 330.6282 Ops/s 328.3451 Ops/s $\color{#35bf28}+0.70\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1184s 9.9326ms 100.6781 Ops/s 100.0533 Ops/s $\color{#35bf28}+0.62\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.1272s 18.1160ms 55.1997 Ops/s 60.7520 Ops/s $\textbf{\color{#d91a1a}-9.14\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 6.8136ms 3.0802ms 324.6549 Ops/s 327.0610 Ops/s $\color{#d91a1a}-0.74\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1154s 10.0999ms 99.0110 Ops/s 80.0169 Ops/s $\textbf{\color{#35bf28}+23.74\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 18.3323ms 15.9854ms 62.5571 Ops/s 59.5002 Ops/s $\textbf{\color{#35bf28}+5.14\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.2076ms 3.2322ms 309.3906 Ops/s 304.5005 Ops/s $\color{#35bf28}+1.61\%$

@vmoens vmoens added the documentation Improvements or additions to documentation label Feb 2, 2024
@vmoens vmoens merged commit c2f43e8 into main Feb 2, 2024
33 of 43 checks passed
@vmoens vmoens deleted the update-fix-tutos branch February 2, 2024 11:54
vmoens added a commit that referenced this pull request Feb 6, 2024
@vmoens
[Doc] Fix tutos (#1863)
0af176f
@vmoens vmoens mentioned this pull request Feb 28, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot