Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BugFix] Remove erroneous python 3.8 compatibility classifier #2540

Merged
merged 1 commit into from
Nov 6, 2024
Merged

[BugFix] Remove erroneous python 3.8 compatibility classifier #2540

merged 1 commit into from
Nov 6, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Nov 6, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Nov 6, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2540

Note: Links to docs will display an error until the docs builds have been completed.

❌ 18 New Failures, 4 Unrelated Failures

As of commit ba27927 with merge base 98b45a6 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 6, 2024
@vmoens vmoens merged commit 528875a into main Nov 6, 2024
12 of 17 checks passed
@vmoens vmoens deleted the vmoens-patch-1 branch November 6, 2024 09:59
@vmoens vmoens added the setup Has to do with installation label Nov 6, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Nov 6, 2024

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 149. Improved: $\large\color{#35bf28}23$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_simple 0.4169s 0.4140s 2.4153 Ops/s 2.1718 Ops/s $\textbf{\color{#35bf28}+11.21\%}$
test_transformed 0.6768s 0.5969s 1.6753 Ops/s 1.5829 Ops/s $\textbf{\color{#35bf28}+5.84\%}$
test_serial 1.3198s 1.3154s 0.7603 Ops/s 0.7287 Ops/s $\color{#35bf28}+4.33\%$
test_parallel 1.2734s 1.2688s 0.7882 Ops/s 0.7588 Ops/s $\color{#35bf28}+3.87\%$
test_step_mdp_speed[True-True-True-True-True] 0.5091ms 26.6030μs 37.5897 KOps/s 36.9281 KOps/s $\color{#35bf28}+1.79\%$
test_step_mdp_speed[True-True-True-True-False] 51.6130μs 15.5698μs 64.2268 KOps/s 62.2906 KOps/s $\color{#35bf28}+3.11\%$
test_step_mdp_speed[True-True-True-False-True] 57.8180μs 15.3291μs 65.2353 KOps/s 63.8165 KOps/s $\color{#35bf28}+2.22\%$
test_step_mdp_speed[True-True-True-False-False] 37.7100μs 8.7812μs 113.8801 KOps/s 110.1189 KOps/s $\color{#35bf28}+3.42\%$
test_step_mdp_speed[True-True-False-True-True] 72.2450μs 28.8030μs 34.7186 KOps/s 33.5719 KOps/s $\color{#35bf28}+3.42\%$
test_step_mdp_speed[True-True-False-True-False] 41.5680μs 17.4775μs 57.2164 KOps/s 56.8721 KOps/s $\color{#35bf28}+0.61\%$
test_step_mdp_speed[True-True-False-False-True] 86.4620μs 16.9126μs 59.1277 KOps/s 57.8219 KOps/s $\color{#35bf28}+2.26\%$
test_step_mdp_speed[True-True-False-False-False] 29.7250μs 10.5137μs 95.1138 KOps/s 92.0008 KOps/s $\color{#35bf28}+3.38\%$
test_step_mdp_speed[True-False-True-True-True] 85.2900μs 29.8045μs 33.5520 KOps/s 32.0846 KOps/s $\color{#35bf28}+4.57\%$
test_step_mdp_speed[True-False-True-True-False] 49.5230μs 19.0141μs 52.5927 KOps/s 51.2202 KOps/s $\color{#35bf28}+2.68\%$
test_step_mdp_speed[True-False-True-False-True] 51.3360μs 16.9307μs 59.0644 KOps/s 57.3489 KOps/s $\color{#35bf28}+2.99\%$
test_step_mdp_speed[True-False-True-False-False] 35.0050μs 10.5365μs 94.9079 KOps/s 91.9345 KOps/s $\color{#35bf28}+3.23\%$
test_step_mdp_speed[True-False-False-True-True] 66.5240μs 31.6829μs 31.5628 KOps/s 29.9206 KOps/s $\textbf{\color{#35bf28}+5.49\%}$
test_step_mdp_speed[True-False-False-True-False] 70.5520μs 20.5163μs 48.7418 KOps/s 47.8311 KOps/s $\color{#35bf28}+1.90\%$
test_step_mdp_speed[True-False-False-False-True] 56.7360μs 18.5774μs 53.8287 KOps/s 52.7162 KOps/s $\color{#35bf28}+2.11\%$
test_step_mdp_speed[True-False-False-False-False] 37.0390μs 12.1661μs 82.1956 KOps/s 81.1132 KOps/s $\color{#35bf28}+1.33\%$
test_step_mdp_speed[False-True-True-True-True] 91.5340μs 30.2048μs 33.1074 KOps/s 32.4050 KOps/s $\color{#35bf28}+2.17\%$
test_step_mdp_speed[False-True-True-True-False] 0.6324ms 19.1723μs 52.1587 KOps/s 50.8775 KOps/s $\color{#35bf28}+2.52\%$
test_step_mdp_speed[False-True-True-False-True] 53.8810μs 19.4558μs 51.3985 KOps/s 50.8117 KOps/s $\color{#35bf28}+1.15\%$
test_step_mdp_speed[False-True-True-False-False] 42.3290μs 11.8868μs 84.1268 KOps/s 82.4158 KOps/s $\color{#35bf28}+2.08\%$
test_step_mdp_speed[False-True-False-True-True] 64.9320μs 31.5960μs 31.6496 KOps/s 30.6711 KOps/s $\color{#35bf28}+3.19\%$
test_step_mdp_speed[False-True-False-True-False] 62.6970μs 20.4557μs 48.8862 KOps/s 46.7699 KOps/s $\color{#35bf28}+4.52\%$
test_step_mdp_speed[False-True-False-False-True] 3.3608ms 20.8502μs 47.9611 KOps/s 46.2294 KOps/s $\color{#35bf28}+3.75\%$
test_step_mdp_speed[False-True-False-False-False] 56.1050μs 13.3734μs 74.7752 KOps/s 72.4634 KOps/s $\color{#35bf28}+3.19\%$
test_step_mdp_speed[False-False-True-True-True] 65.9340μs 33.9575μs 29.4486 KOps/s 28.7991 KOps/s $\color{#35bf28}+2.26\%$
test_step_mdp_speed[False-False-True-True-False] 47.3090μs 21.9762μs 45.5038 KOps/s 44.1028 KOps/s $\color{#35bf28}+3.18\%$
test_step_mdp_speed[False-False-True-False-True] 51.6060μs 20.6867μs 48.3403 KOps/s 46.7816 KOps/s $\color{#35bf28}+3.33\%$
test_step_mdp_speed[False-False-True-False-False] 41.4770μs 13.2278μs 75.5983 KOps/s 72.6719 KOps/s $\color{#35bf28}+4.03\%$
test_step_mdp_speed[False-False-False-True-True] 68.2470μs 34.2221μs 29.2209 KOps/s 27.5201 KOps/s $\textbf{\color{#35bf28}+6.18\%}$
test_step_mdp_speed[False-False-False-True-False] 54.2210μs 23.6005μs 42.3720 KOps/s 41.4420 KOps/s $\color{#35bf28}+2.24\%$
test_step_mdp_speed[False-False-False-False-True] 50.2540μs 22.1526μs 45.1414 KOps/s 44.0934 KOps/s $\color{#35bf28}+2.38\%$
test_step_mdp_speed[False-False-False-False-False] 43.7620μs 14.8497μs 67.3413 KOps/s 65.6978 KOps/s $\color{#35bf28}+2.50\%$
test_values[generalized_advantage_estimate-True-True] 11.0083ms 9.8420ms 101.6057 Ops/s 104.8115 Ops/s $\color{#d91a1a}-3.06\%$
test_values[vec_generalized_advantage_estimate-True-True] 35.5995ms 33.4712ms 29.8764 Ops/s 29.7703 Ops/s $\color{#35bf28}+0.36\%$
test_values[td0_return_estimate-False-False] 0.2485ms 0.1822ms 5.4881 KOps/s 5.1141 KOps/s $\textbf{\color{#35bf28}+7.31\%}$
test_values[td1_return_estimate-False-False] 25.8525ms 25.0434ms 39.9307 Ops/s 40.1911 Ops/s $\color{#d91a1a}-0.65\%$
test_values[vec_td1_return_estimate-False-False] 35.1237ms 33.4801ms 29.8684 Ops/s 29.7916 Ops/s $\color{#35bf28}+0.26\%$
test_values[td_lambda_return_estimate-True-False] 38.6135ms 35.6702ms 28.0346 Ops/s 28.2789 Ops/s $\color{#d91a1a}-0.86\%$
test_values[vec_td_lambda_return_estimate-True-False] 34.3527ms 33.4387ms 29.9055 Ops/s 29.8201 Ops/s $\color{#35bf28}+0.29\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.6378ms 8.4984ms 117.6686 Ops/s 119.0742 Ops/s $\color{#d91a1a}-1.18\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.1518ms 1.9101ms 523.5378 Ops/s 528.1410 Ops/s $\color{#d91a1a}-0.87\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5447ms 0.3570ms 2.8015 KOps/s 2.7927 KOps/s $\color{#35bf28}+0.32\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 42.9843ms 39.5441ms 25.2882 Ops/s 23.9087 Ops/s $\textbf{\color{#35bf28}+5.77\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.7704ms 3.0367ms 329.3082 Ops/s 328.4210 Ops/s $\color{#35bf28}+0.27\%$
test_dqn_speed[False-None] 6.6250ms 1.3111ms 762.7143 Ops/s 753.2148 Ops/s $\color{#35bf28}+1.26\%$
test_dqn_speed[False-backward] 1.8821ms 1.7801ms 561.7592 Ops/s 552.3054 Ops/s $\color{#35bf28}+1.71\%$
test_dqn_speed[True-None] 1.2485ms 0.4620ms 2.1646 KOps/s 2.1515 KOps/s $\color{#35bf28}+0.61\%$
test_dqn_speed[True-backward] 0.9518ms 0.8857ms 1.1291 KOps/s 1.1219 KOps/s $\color{#35bf28}+0.64\%$
test_dqn_speed[reduce-overhead-None] 0.6775ms 0.4716ms 2.1204 KOps/s 2.1198 KOps/s $\color{#35bf28}+0.03\%$
test_dqn_speed[reduce-overhead-backward] 0.9288ms 0.8892ms 1.1246 KOps/s 1.1232 KOps/s $\color{#35bf28}+0.13\%$
test_ddpg_speed[False-None] 3.6111ms 2.7390ms 365.0943 Ops/s 358.1855 Ops/s $\color{#35bf28}+1.93\%$
test_ddpg_speed[False-backward] 4.4376ms 3.9037ms 256.1694 Ops/s 254.4247 Ops/s $\color{#35bf28}+0.69\%$
test_ddpg_speed[True-None] 1.2990ms 1.0079ms 992.1887 Ops/s 989.4988 Ops/s $\color{#35bf28}+0.27\%$
test_ddpg_speed[True-backward] 2.0014ms 1.9132ms 522.6975 Ops/s 517.3122 Ops/s $\color{#35bf28}+1.04\%$
test_ddpg_speed[reduce-overhead-None] 1.4008ms 1.0067ms 993.3836 Ops/s 984.7685 Ops/s $\color{#35bf28}+0.87\%$
test_ddpg_speed[reduce-overhead-backward] 2.5169ms 1.9586ms 510.5713 Ops/s 518.8797 Ops/s $\color{#d91a1a}-1.60\%$
test_sac_speed[False-None] 8.1899ms 7.6797ms 130.2128 Ops/s 125.9153 Ops/s $\color{#35bf28}+3.41\%$
test_sac_speed[False-backward] 10.9447ms 10.4927ms 95.3043 Ops/s 92.0177 Ops/s $\color{#35bf28}+3.57\%$
test_sac_speed[True-None] 2.0638ms 1.8352ms 544.9123 Ops/s 534.5547 Ops/s $\color{#35bf28}+1.94\%$
test_sac_speed[True-backward] 3.6889ms 3.5336ms 282.9958 Ops/s 277.3529 Ops/s $\color{#35bf28}+2.03\%$
test_sac_speed[reduce-overhead-None] 2.0873ms 1.8282ms 546.9966 Ops/s 537.0227 Ops/s $\color{#35bf28}+1.86\%$
test_sac_speed[reduce-overhead-backward] 4.2594ms 3.5927ms 278.3434 Ops/s 277.7229 Ops/s $\color{#35bf28}+0.22\%$
test_redq_speed[False-None] 13.7943ms 12.7686ms 78.3168 Ops/s 75.7989 Ops/s $\color{#35bf28}+3.32\%$
test_redq_speed[False-backward] 24.4919ms 22.4967ms 44.4511 Ops/s 44.1624 Ops/s $\color{#35bf28}+0.65\%$
test_redq_speed[True-None] 6.1726ms 4.8823ms 204.8221 Ops/s 190.7588 Ops/s $\textbf{\color{#35bf28}+7.37\%}$
test_redq_speed[True-backward] 13.3342ms 12.4619ms 80.2447 Ops/s 79.7454 Ops/s $\color{#35bf28}+0.63\%$
test_redq_speed[reduce-overhead-None] 5.2735ms 4.7471ms 210.6567 Ops/s 215.8452 Ops/s $\color{#d91a1a}-2.40\%$
test_redq_speed[reduce-overhead-backward] 13.0653ms 12.4907ms 80.0595 Ops/s 80.8294 Ops/s $\color{#d91a1a}-0.95\%$
test_redq_deprec_speed[False-None] 14.3019ms 12.9260ms 77.3632 Ops/s 76.6027 Ops/s $\color{#35bf28}+0.99\%$
test_redq_deprec_speed[False-backward] 20.9403ms 18.6644ms 53.5778 Ops/s 52.6078 Ops/s $\color{#35bf28}+1.84\%$
test_redq_deprec_speed[True-None] 5.2635ms 4.0273ms 248.3052 Ops/s 273.1105 Ops/s $\textbf{\color{#d91a1a}-9.08\%}$
test_redq_deprec_speed[True-backward] 8.8003ms 8.3771ms 119.3724 Ops/s 119.1791 Ops/s $\color{#35bf28}+0.16\%$
test_redq_deprec_speed[reduce-overhead-None] 4.0372ms 3.6071ms 277.2324 Ops/s 275.6764 Ops/s $\color{#35bf28}+0.56\%$
test_redq_deprec_speed[reduce-overhead-backward] 9.4809ms 8.2720ms 120.8897 Ops/s 113.9783 Ops/s $\textbf{\color{#35bf28}+6.06\%}$
test_td3_speed[False-None] 36.0708ms 7.8392ms 127.5635 Ops/s 126.9119 Ops/s $\color{#35bf28}+0.51\%$
test_td3_speed[False-backward] 10.3522ms 9.9946ms 100.0541 Ops/s 92.0226 Ops/s $\textbf{\color{#35bf28}+8.73\%}$
test_td3_speed[True-None] 1.9327ms 1.7073ms 585.7257 Ops/s 573.9828 Ops/s $\color{#35bf28}+2.05\%$
test_td3_speed[True-backward] 3.5334ms 3.4506ms 289.8029 Ops/s 287.8617 Ops/s $\color{#35bf28}+0.67\%$
test_td3_speed[reduce-overhead-None] 2.2867ms 1.7137ms 583.5183 Ops/s 573.8345 Ops/s $\color{#35bf28}+1.69\%$
test_td3_speed[reduce-overhead-backward] 3.7499ms 3.4612ms 288.9193 Ops/s 299.8668 Ops/s $\color{#d91a1a}-3.65\%$
test_cql_speed[False-None] 39.4674ms 36.1996ms 27.6246 Ops/s 28.0250 Ops/s $\color{#d91a1a}-1.43\%$
test_cql_speed[False-backward] 50.4098ms 46.7871ms 21.3734 Ops/s 21.7547 Ops/s $\color{#d91a1a}-1.75\%$
test_cql_speed[True-None] 16.9000ms 15.8337ms 63.1564 Ops/s 63.1133 Ops/s $\color{#35bf28}+0.07\%$
test_cql_speed[True-backward] 23.5186ms 22.5784ms 44.2900 Ops/s 43.5740 Ops/s $\color{#35bf28}+1.64\%$
test_cql_speed[reduce-overhead-None] 16.9213ms 15.6931ms 63.7224 Ops/s 62.4823 Ops/s $\color{#35bf28}+1.98\%$
test_cql_speed[reduce-overhead-backward] 28.1960ms 22.5982ms 44.2513 Ops/s 42.7633 Ops/s $\color{#35bf28}+3.48\%$
test_a2c_speed[False-None] 8.4818ms 7.0186ms 142.4776 Ops/s 132.9343 Ops/s $\textbf{\color{#35bf28}+7.18\%}$
test_a2c_speed[False-backward] 14.8605ms 14.0372ms 71.2391 Ops/s 66.4744 Ops/s $\textbf{\color{#35bf28}+7.17\%}$
test_a2c_speed[True-None] 3.8433ms 3.3082ms 302.2780 Ops/s 302.5650 Ops/s $\color{#d91a1a}-0.09\%$
test_a2c_speed[True-backward] 10.0875ms 9.6712ms 103.3997 Ops/s 101.8481 Ops/s $\color{#35bf28}+1.52\%$
test_a2c_speed[reduce-overhead-None] 3.7062ms 3.2875ms 304.1838 Ops/s 301.4921 Ops/s $\color{#35bf28}+0.89\%$
test_a2c_speed[reduce-overhead-backward] 10.4474ms 9.7324ms 102.7493 Ops/s 98.4223 Ops/s $\color{#35bf28}+4.40\%$
test_ppo_speed[False-None] 8.2225ms 7.3363ms 136.3091 Ops/s 130.0559 Ops/s $\color{#35bf28}+4.81\%$
test_ppo_speed[False-backward] 16.2484ms 14.5411ms 68.7705 Ops/s 65.2334 Ops/s $\textbf{\color{#35bf28}+5.42\%}$
test_ppo_speed[True-None] 4.3397ms 3.6810ms 271.6626 Ops/s 266.1628 Ops/s $\color{#35bf28}+2.07\%$
test_ppo_speed[True-backward] 10.7753ms 9.5517ms 104.6932 Ops/s 103.2649 Ops/s $\color{#35bf28}+1.38\%$
test_ppo_speed[reduce-overhead-None] 4.3171ms 3.6722ms 272.3189 Ops/s 270.2894 Ops/s $\color{#35bf28}+0.75\%$
test_ppo_speed[reduce-overhead-backward] 9.9190ms 9.5251ms 104.9856 Ops/s 102.1242 Ops/s $\color{#35bf28}+2.80\%$
test_reinforce_speed[False-None] 8.0598ms 6.3992ms 156.2695 Ops/s 153.0663 Ops/s $\color{#35bf28}+2.09\%$
test_reinforce_speed[False-backward] 12.3669ms 9.7752ms 102.2996 Ops/s 100.8343 Ops/s $\color{#35bf28}+1.45\%$
test_reinforce_speed[True-None] 3.3009ms 2.6893ms 371.8425 Ops/s 376.8075 Ops/s $\color{#d91a1a}-1.32\%$
test_reinforce_speed[True-backward] 9.4551ms 8.7953ms 113.6977 Ops/s 115.2833 Ops/s $\color{#d91a1a}-1.38\%$
test_reinforce_speed[reduce-overhead-None] 3.0023ms 2.6248ms 380.9830 Ops/s 375.4849 Ops/s $\color{#35bf28}+1.46\%$
test_reinforce_speed[reduce-overhead-backward] 9.2230ms 8.7479ms 114.3127 Ops/s 113.5912 Ops/s $\color{#35bf28}+0.64\%$
test_iql_speed[False-None] 32.5780ms 31.2962ms 31.9528 Ops/s 31.1472 Ops/s $\color{#35bf28}+2.59\%$
test_iql_speed[False-backward] 46.2499ms 44.3483ms 22.5488 Ops/s 21.9974 Ops/s $\color{#35bf28}+2.51\%$
test_iql_speed[True-None] 11.4003ms 10.5945ms 94.3888 Ops/s 93.1645 Ops/s $\color{#35bf28}+1.31\%$
test_iql_speed[True-backward] 22.5280ms 21.5289ms 46.4492 Ops/s 45.1163 Ops/s $\color{#35bf28}+2.95\%$
test_iql_speed[reduce-overhead-None] 13.9818ms 10.9808ms 91.0677 Ops/s 91.1740 Ops/s $\color{#d91a1a}-0.12\%$
test_iql_speed[reduce-overhead-backward] 22.4542ms 21.9463ms 45.5658 Ops/s 44.3725 Ops/s $\color{#35bf28}+2.69\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.1147ms 4.8610ms 205.7207 Ops/s 188.8053 Ops/s $\textbf{\color{#35bf28}+8.96\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7808ms 0.5043ms 1.9830 KOps/s 1.8881 KOps/s $\textbf{\color{#35bf28}+5.02\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.9167ms 0.4829ms 2.0706 KOps/s 1.9984 KOps/s $\color{#35bf28}+3.61\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 7.1914ms 4.6681ms 214.2214 Ops/s 205.6986 Ops/s $\color{#35bf28}+4.14\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.3973ms 0.4970ms 2.0123 KOps/s 1.9541 KOps/s $\color{#35bf28}+2.98\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.8079ms 0.4727ms 2.1156 KOps/s 2.0498 KOps/s $\color{#35bf28}+3.21\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.1650ms 1.6302ms 613.4229 Ops/s 612.4610 Ops/s $\color{#35bf28}+0.16\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.8706ms 1.5626ms 639.9681 Ops/s 631.3369 Ops/s $\color{#35bf28}+1.37\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.0376ms 4.8208ms 207.4337 Ops/s 199.4666 Ops/s $\color{#35bf28}+3.99\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1059ms 0.6350ms 1.5747 KOps/s 1.4756 KOps/s $\textbf{\color{#35bf28}+6.71\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0884ms 0.6156ms 1.6244 KOps/s 1.5879 KOps/s $\color{#35bf28}+2.30\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.4114ms 4.5998ms 217.4009 Ops/s 204.6558 Ops/s $\textbf{\color{#35bf28}+6.23\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.1596ms 0.5038ms 1.9847 KOps/s 1.8984 KOps/s $\color{#35bf28}+4.55\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.8083ms 0.4840ms 2.0660 KOps/s 1.9909 KOps/s $\color{#35bf28}+3.77\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 7.3800ms 4.6514ms 214.9873 Ops/s 208.1933 Ops/s $\color{#35bf28}+3.26\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.2380ms 0.4928ms 2.0293 KOps/s 1.9513 KOps/s $\color{#35bf28}+3.99\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6897ms 0.4661ms 2.1454 KOps/s 2.0370 KOps/s $\textbf{\color{#35bf28}+5.32\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.1020ms 4.6803ms 213.6632 Ops/s 199.7655 Ops/s $\textbf{\color{#35bf28}+6.96\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 3.0166ms 0.6360ms 1.5724 KOps/s 1.5281 KOps/s $\color{#35bf28}+2.90\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0323ms 0.6146ms 1.6271 KOps/s 1.6014 KOps/s $\color{#35bf28}+1.61\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 5.4074ms 4.1035ms 243.6916 Ops/s 249.2897 Ops/s $\color{#d91a1a}-2.25\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 7.0102ms 2.2925ms 436.2072 Ops/s 465.0048 Ops/s $\textbf{\color{#d91a1a}-6.19\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 4.8971ms 1.2964ms 771.3396 Ops/s 823.3961 Ops/s $\textbf{\color{#d91a1a}-6.32\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.4058s 12.2296ms 81.7688 Ops/s 34.5039 Ops/s $\textbf{\color{#35bf28}+136.98\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 8.8616ms 2.3578ms 424.1215 Ops/s 410.2856 Ops/s $\color{#35bf28}+3.37\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.6216ms 1.3032ms 767.3633 Ops/s 695.4245 Ops/s $\textbf{\color{#35bf28}+10.34\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 7.0222ms 4.3279ms 231.0569 Ops/s 214.3524 Ops/s $\textbf{\color{#35bf28}+7.79\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 5.2990ms 2.4399ms 409.8517 Ops/s 370.9378 Ops/s $\textbf{\color{#35bf28}+10.49\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.7052ms 1.5510ms 644.7604 Ops/s 610.6451 Ops/s $\textbf{\color{#35bf28}+5.59\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 12.1574ms 10.9043ms 91.7065 Ops/s 92.6813 Ops/s $\color{#d91a1a}-1.05\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 16.3292ms 14.2107ms 70.3695 Ops/s 70.8045 Ops/s $\color{#d91a1a}-0.61\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 21.6530ms 20.0998ms 49.7516 Ops/s 51.1631 Ops/s $\color{#d91a1a}-2.76\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 16.5804ms 14.2722ms 70.0661 Ops/s 69.9238 Ops/s $\color{#35bf28}+0.20\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 21.0407ms 19.9355ms 50.1617 Ops/s 50.7351 Ops/s $\color{#d91a1a}-1.13\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 16.0306ms 15.5117ms 64.4673 Ops/s 63.9433 Ops/s $\color{#35bf28}+0.82\%$

@github-actions GitHub Actions
Copy link

github-actions bot commented Nov 6, 2024

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 149. Improved: $\large\color{#35bf28}15$. Worsened: $\large\color{#d91a1a}10$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_simple 0.7564s 0.7509s 1.3318 Ops/s 1.2948 Ops/s $\color{#35bf28}+2.86\%$
test_transformed 1.0881s 1.0112s 0.9889 Ops/s 1.0080 Ops/s $\color{#d91a1a}-1.90\%$
test_serial 2.2522s 2.1748s 0.4598 Ops/s 0.4623 Ops/s $\color{#d91a1a}-0.54\%$
test_parallel 2.0890s 1.9914s 0.5022 Ops/s 0.4925 Ops/s $\color{#35bf28}+1.95\%$
test_step_mdp_speed[True-True-True-True-True] 0.4072ms 35.7699μs 27.9565 KOps/s 28.7282 KOps/s $\color{#d91a1a}-2.69\%$
test_step_mdp_speed[True-True-True-True-False] 0.4029ms 21.0773μs 47.4445 KOps/s 49.1115 KOps/s $\color{#d91a1a}-3.39\%$
test_step_mdp_speed[True-True-True-False-True] 49.2010μs 20.0064μs 49.9841 KOps/s 49.9963 KOps/s $\color{#d91a1a}-0.02\%$
test_step_mdp_speed[True-True-True-False-False] 0.3895ms 11.8252μs 84.5651 KOps/s 85.6125 KOps/s $\color{#d91a1a}-1.22\%$
test_step_mdp_speed[True-True-False-True-True] 0.4204ms 39.2097μs 25.5039 KOps/s 25.8184 KOps/s $\color{#d91a1a}-1.22\%$
test_step_mdp_speed[True-True-False-True-False] 50.6710μs 22.9179μs 43.6340 KOps/s 44.3974 KOps/s $\color{#d91a1a}-1.72\%$
test_step_mdp_speed[True-True-False-False-True] 0.4138ms 22.1868μs 45.0718 KOps/s 45.0882 KOps/s $\color{#d91a1a}-0.04\%$
test_step_mdp_speed[True-True-False-False-False] 0.3883ms 13.9400μs 71.7361 KOps/s 73.5391 KOps/s $\color{#d91a1a}-2.45\%$
test_step_mdp_speed[True-False-True-True-True] 0.4198ms 40.5296μs 24.6733 KOps/s 24.5980 KOps/s $\color{#35bf28}+0.31\%$
test_step_mdp_speed[True-False-True-True-False] 94.1620μs 25.1702μs 39.7296 KOps/s 39.9983 KOps/s $\color{#d91a1a}-0.67\%$
test_step_mdp_speed[True-False-True-False-True] 55.9110μs 22.0124μs 45.4290 KOps/s 45.0308 KOps/s $\color{#35bf28}+0.88\%$
test_step_mdp_speed[True-False-True-False-False] 39.0910μs 13.7743μs 72.5991 KOps/s 73.4156 KOps/s $\color{#d91a1a}-1.11\%$
test_step_mdp_speed[True-False-False-True-True] 0.1114ms 42.3458μs 23.6151 KOps/s 23.6629 KOps/s $\color{#d91a1a}-0.20\%$
test_step_mdp_speed[True-False-False-True-False] 55.0810μs 26.5985μs 37.5961 KOps/s 37.4326 KOps/s $\color{#35bf28}+0.44\%$
test_step_mdp_speed[True-False-False-False-True] 54.6010μs 23.8685μs 41.8962 KOps/s 41.3652 KOps/s $\color{#35bf28}+1.28\%$
test_step_mdp_speed[True-False-False-False-False] 44.9910μs 15.8300μs 63.1711 KOps/s 64.1121 KOps/s $\color{#d91a1a}-1.47\%$
test_step_mdp_speed[False-True-True-True-True] 0.1260ms 40.3687μs 24.7717 KOps/s 24.6007 KOps/s $\color{#35bf28}+0.69\%$
test_step_mdp_speed[False-True-True-True-False] 94.5010μs 24.7543μs 40.3970 KOps/s 40.4126 KOps/s $\color{#d91a1a}-0.04\%$
test_step_mdp_speed[False-True-True-False-True] 54.0610μs 25.9644μs 38.5143 KOps/s 38.7485 KOps/s $\color{#d91a1a}-0.60\%$
test_step_mdp_speed[False-True-True-False-False] 40.8510μs 15.4715μs 64.6351 KOps/s 65.4852 KOps/s $\color{#d91a1a}-1.30\%$
test_step_mdp_speed[False-True-False-True-True] 79.1110μs 42.9755μs 23.2691 KOps/s 23.2635 KOps/s $\color{#35bf28}+0.02\%$
test_step_mdp_speed[False-True-False-True-False] 55.6910μs 26.8270μs 37.2758 KOps/s 37.4834 KOps/s $\color{#d91a1a}-0.55\%$
test_step_mdp_speed[False-True-False-False-True] 3.5185ms 27.8191μs 35.9466 KOps/s 35.6228 KOps/s $\color{#35bf28}+0.91\%$
test_step_mdp_speed[False-True-False-False-False] 46.8210μs 17.4677μs 57.2486 KOps/s 58.2282 KOps/s $\color{#d91a1a}-1.68\%$
test_step_mdp_speed[False-False-True-True-True] 75.4810μs 44.2488μs 22.5995 KOps/s 22.2437 KOps/s $\color{#35bf28}+1.60\%$
test_step_mdp_speed[False-False-True-True-False] 59.9010μs 29.0434μs 34.4312 KOps/s 34.2857 KOps/s $\color{#35bf28}+0.42\%$
test_step_mdp_speed[False-False-True-False-True] 64.2810μs 28.0258μs 35.6814 KOps/s 36.0096 KOps/s $\color{#d91a1a}-0.91\%$
test_step_mdp_speed[False-False-True-False-False] 51.4410μs 17.5522μs 56.9730 KOps/s 58.0667 KOps/s $\color{#d91a1a}-1.88\%$
test_step_mdp_speed[False-False-False-True-True] 79.7710μs 45.7039μs 21.8800 KOps/s 22.4462 KOps/s $\color{#d91a1a}-2.52\%$
test_step_mdp_speed[False-False-False-True-False] 57.0810μs 30.7198μs 32.5523 KOps/s 32.5028 KOps/s $\color{#35bf28}+0.15\%$
test_step_mdp_speed[False-False-False-False-True] 60.4410μs 29.1659μs 34.2867 KOps/s 34.4098 KOps/s $\color{#d91a1a}-0.36\%$
test_step_mdp_speed[False-False-False-False-False] 45.3910μs 19.3292μs 51.7351 KOps/s 53.1420 KOps/s $\color{#d91a1a}-2.65\%$
test_values[generalized_advantage_estimate-True-True] 25.6537ms 25.1761ms 39.7202 Ops/s 39.9123 Ops/s $\color{#d91a1a}-0.48\%$
test_values[vec_generalized_advantage_estimate-True-True] 0.1042s 2.9821ms 335.3391 Ops/s 328.4098 Ops/s $\color{#35bf28}+2.11\%$
test_values[td0_return_estimate-False-False] 88.7020μs 67.8658μs 14.7350 KOps/s 14.6304 KOps/s $\color{#35bf28}+0.71\%$
test_values[td1_return_estimate-False-False] 56.4620ms 56.2248ms 17.7857 Ops/s 17.9576 Ops/s $\color{#d91a1a}-0.96\%$
test_values[vec_td1_return_estimate-False-False] 1.3644ms 1.0898ms 917.5978 Ops/s 918.0484 Ops/s $\color{#d91a1a}-0.05\%$
test_values[td_lambda_return_estimate-True-False] 90.2301ms 89.9117ms 11.1220 Ops/s 11.3050 Ops/s $\color{#d91a1a}-1.62\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.3725ms 1.0887ms 918.5250 Ops/s 917.6222 Ops/s $\color{#35bf28}+0.10\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 25.2771ms 25.0868ms 39.8616 Ops/s 40.2915 Ops/s $\color{#d91a1a}-1.07\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.0468ms 0.7555ms 1.3236 KOps/s 1.3185 KOps/s $\color{#35bf28}+0.39\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7732ms 0.6746ms 1.4823 KOps/s 1.4932 KOps/s $\color{#d91a1a}-0.73\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5517ms 1.4843ms 673.7247 Ops/s 674.4893 Ops/s $\color{#d91a1a}-0.11\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.7438ms 0.6887ms 1.4520 KOps/s 1.4604 KOps/s $\color{#d91a1a}-0.57\%$
test_dqn_speed[False-None] 6.8486ms 1.3252ms 754.6084 Ops/s 755.4616 Ops/s $\color{#d91a1a}-0.11\%$
test_dqn_speed[False-backward] 1.8983ms 1.8243ms 548.1684 Ops/s 539.0942 Ops/s $\color{#35bf28}+1.68\%$
test_dqn_speed[True-None] 1.1150ms 0.6000ms 1.6666 KOps/s 1.7130 KOps/s $\color{#d91a1a}-2.71\%$
test_dqn_speed[True-backward] 1.0707ms 1.0080ms 992.0656 Ops/s 805.5095 Ops/s $\textbf{\color{#35bf28}+23.16\%}$
test_dqn_speed[reduce-overhead-None] 0.7024ms 0.5557ms 1.7995 KOps/s 1.6936 KOps/s $\textbf{\color{#35bf28}+6.25\%}$
test_dqn_speed[reduce-overhead-backward] 1.0655ms 1.0220ms 978.4328 Ops/s 909.7509 Ops/s $\textbf{\color{#35bf28}+7.55\%}$
test_ddpg_speed[False-None] 3.0645ms 2.7111ms 368.8547 Ops/s 361.1955 Ops/s $\color{#35bf28}+2.12\%$
test_ddpg_speed[False-backward] 4.0624ms 3.9468ms 253.3683 Ops/s 252.2122 Ops/s $\color{#35bf28}+0.46\%$
test_ddpg_speed[True-None] 1.3583ms 1.2323ms 811.4882 Ops/s 779.3130 Ops/s $\color{#35bf28}+4.13\%$
test_ddpg_speed[True-backward] 2.2813ms 2.2340ms 447.6181 Ops/s 427.5661 Ops/s $\color{#35bf28}+4.69\%$
test_ddpg_speed[reduce-overhead-None] 1.6369ms 1.2462ms 802.4357 Ops/s 793.0596 Ops/s $\color{#35bf28}+1.18\%$
test_ddpg_speed[reduce-overhead-backward] 2.2710ms 2.2273ms 448.9702 Ops/s 440.6238 Ops/s $\color{#35bf28}+1.89\%$
test_sac_speed[False-None] 8.4332ms 7.5714ms 132.0758 Ops/s 131.1660 Ops/s $\color{#35bf28}+0.69\%$
test_sac_speed[False-backward] 11.3054ms 10.8235ms 92.3916 Ops/s 91.8439 Ops/s $\color{#35bf28}+0.60\%$
test_sac_speed[True-None] 2.1910ms 2.0326ms 491.9763 Ops/s 492.8464 Ops/s $\color{#d91a1a}-0.18\%$
test_sac_speed[True-backward] 4.0271ms 3.9398ms 253.8192 Ops/s 249.3528 Ops/s $\color{#35bf28}+1.79\%$
test_sac_speed[reduce-overhead-None] 2.3575ms 2.0072ms 498.2074 Ops/s 496.1891 Ops/s $\color{#35bf28}+0.41\%$
test_sac_speed[reduce-overhead-backward] 4.1374ms 3.9808ms 251.2032 Ops/s 255.7675 Ops/s $\color{#d91a1a}-1.78\%$
test_redq_speed[False-None] 13.3672ms 10.0490ms 99.5124 Ops/s 100.0887 Ops/s $\color{#d91a1a}-0.58\%$
test_redq_speed[False-backward] 17.8099ms 17.2504ms 57.9697 Ops/s 59.0414 Ops/s $\color{#d91a1a}-1.82\%$
test_redq_speed[True-None] 3.9012ms 3.6056ms 277.3429 Ops/s 271.1765 Ops/s $\color{#35bf28}+2.27\%$
test_redq_speed[True-backward] 8.9964ms 8.7807ms 113.8865 Ops/s 115.6118 Ops/s $\color{#d91a1a}-1.49\%$
test_redq_speed[reduce-overhead-None] 3.7243ms 3.5134ms 284.6284 Ops/s 274.5811 Ops/s $\color{#35bf28}+3.66\%$
test_redq_speed[reduce-overhead-backward] 9.0700ms 8.8239ms 113.3290 Ops/s 115.5753 Ops/s $\color{#d91a1a}-1.94\%$
test_redq_deprec_speed[False-None] 12.6199ms 10.7371ms 93.1350 Ops/s 89.9451 Ops/s $\color{#35bf28}+3.55\%$
test_redq_deprec_speed[False-backward] 16.7776ms 15.6668ms 63.8291 Ops/s 60.8693 Ops/s $\color{#35bf28}+4.86\%$
test_redq_deprec_speed[True-None] 3.7016ms 3.3138ms 301.7668 Ops/s 292.5611 Ops/s $\color{#35bf28}+3.15\%$
test_redq_deprec_speed[True-backward] 7.4201ms 7.1778ms 139.3175 Ops/s 128.0114 Ops/s $\textbf{\color{#35bf28}+8.83\%}$
test_redq_deprec_speed[reduce-overhead-None] 3.6554ms 3.2354ms 309.0824 Ops/s 293.6405 Ops/s $\textbf{\color{#35bf28}+5.26\%}$
test_redq_deprec_speed[reduce-overhead-backward] 7.5213ms 7.1896ms 139.0904 Ops/s 129.1702 Ops/s $\textbf{\color{#35bf28}+7.68\%}$
test_td3_speed[False-None] 7.6843ms 7.5073ms 133.2032 Ops/s 131.7985 Ops/s $\color{#35bf28}+1.07\%$
test_td3_speed[False-backward] 10.7663ms 10.4282ms 95.8936 Ops/s 94.9303 Ops/s $\color{#35bf28}+1.01\%$
test_td3_speed[True-None] 1.9300ms 1.8896ms 529.2262 Ops/s 509.8739 Ops/s $\color{#35bf28}+3.80\%$
test_td3_speed[True-backward] 4.2462ms 3.7341ms 267.8055 Ops/s 265.1906 Ops/s $\color{#35bf28}+0.99\%$
test_td3_speed[reduce-overhead-None] 1.9384ms 1.8968ms 527.1946 Ops/s 527.3853 Ops/s $\color{#d91a1a}-0.04\%$
test_td3_speed[reduce-overhead-backward] 3.8430ms 3.7049ms 269.9102 Ops/s 267.0090 Ops/s $\color{#35bf28}+1.09\%$
test_cql_speed[False-None] 30.1271ms 25.4890ms 39.2326 Ops/s 40.8283 Ops/s $\color{#d91a1a}-3.91\%$
test_cql_speed[False-backward] 38.3846ms 34.9090ms 28.6459 Ops/s 29.6144 Ops/s $\color{#d91a1a}-3.27\%$
test_cql_speed[True-None] 11.1115ms 10.8551ms 92.1230 Ops/s 95.7064 Ops/s $\color{#d91a1a}-3.74\%$
test_cql_speed[True-backward] 17.3354ms 16.8714ms 59.2720 Ops/s 62.0673 Ops/s $\color{#d91a1a}-4.50\%$
test_cql_speed[reduce-overhead-None] 11.1384ms 10.8630ms 92.0556 Ops/s 95.0214 Ops/s $\color{#d91a1a}-3.12\%$
test_cql_speed[reduce-overhead-backward] 16.7418ms 16.4933ms 60.6307 Ops/s 61.4835 Ops/s $\color{#d91a1a}-1.39\%$
test_a2c_speed[False-None] 5.6383ms 5.2409ms 190.8085 Ops/s 186.2724 Ops/s $\color{#35bf28}+2.44\%$
test_a2c_speed[False-backward] 12.4247ms 11.8011ms 84.7379 Ops/s 84.3456 Ops/s $\color{#35bf28}+0.47\%$
test_a2c_speed[True-None] 3.4248ms 3.0170ms 331.4559 Ops/s 333.1132 Ops/s $\color{#d91a1a}-0.50\%$
test_a2c_speed[True-backward] 8.6616ms 8.4349ms 118.5551 Ops/s 120.2926 Ops/s $\color{#d91a1a}-1.44\%$
test_a2c_speed[reduce-overhead-None] 3.8751ms 3.0710ms 325.6257 Ops/s 330.0209 Ops/s $\color{#d91a1a}-1.33\%$
test_a2c_speed[reduce-overhead-backward] 8.5580ms 8.3997ms 119.0516 Ops/s 118.7058 Ops/s $\color{#35bf28}+0.29\%$
test_ppo_speed[False-None] 5.8759ms 5.6657ms 176.5017 Ops/s 174.1983 Ops/s $\color{#35bf28}+1.32\%$
test_ppo_speed[False-backward] 14.2759ms 12.4733ms 80.1710 Ops/s 81.4851 Ops/s $\color{#d91a1a}-1.61\%$
test_ppo_speed[True-None] 3.5406ms 3.3858ms 295.3505 Ops/s 292.3993 Ops/s $\color{#35bf28}+1.01\%$
test_ppo_speed[True-backward] 8.4199ms 8.2036ms 121.8977 Ops/s 122.4822 Ops/s $\color{#d91a1a}-0.48\%$
test_ppo_speed[reduce-overhead-None] 3.5269ms 3.3913ms 294.8701 Ops/s 294.9676 Ops/s $\color{#d91a1a}-0.03\%$
test_ppo_speed[reduce-overhead-backward] 8.3736ms 8.2201ms 121.6535 Ops/s 121.1114 Ops/s $\color{#35bf28}+0.45\%$
test_reinforce_speed[False-None] 4.8139ms 4.4576ms 224.3350 Ops/s 223.2637 Ops/s $\color{#35bf28}+0.48\%$
test_reinforce_speed[False-backward] 7.5230ms 7.3271ms 136.4799 Ops/s 136.5605 Ops/s $\color{#d91a1a}-0.06\%$
test_reinforce_speed[True-None] 2.6224ms 2.1874ms 457.1567 Ops/s 458.7894 Ops/s $\color{#d91a1a}-0.36\%$
test_reinforce_speed[True-backward] 7.2359ms 7.0691ms 141.4604 Ops/s 136.2521 Ops/s $\color{#35bf28}+3.82\%$
test_reinforce_speed[reduce-overhead-None] 2.5471ms 2.1982ms 454.9090 Ops/s 460.7347 Ops/s $\color{#d91a1a}-1.26\%$
test_reinforce_speed[reduce-overhead-backward] 7.5131ms 6.9815ms 143.2348 Ops/s 141.9865 Ops/s $\color{#35bf28}+0.88\%$
test_iql_speed[False-None] 0.2984s 24.9187ms 40.1306 Ops/s 52.3242 Ops/s $\textbf{\color{#d91a1a}-23.30\%}$
test_iql_speed[False-backward] 30.8081ms 30.3737ms 32.9232 Ops/s 33.5831 Ops/s $\color{#d91a1a}-1.96\%$
test_iql_speed[True-None] 7.1071ms 6.7040ms 149.1636 Ops/s 150.0142 Ops/s $\color{#d91a1a}-0.57\%$
test_iql_speed[True-backward] 15.6436ms 15.3528ms 65.1347 Ops/s 64.4898 Ops/s $\color{#35bf28}+1.00\%$
test_iql_speed[reduce-overhead-None] 7.0580ms 6.6737ms 149.8423 Ops/s 148.5155 Ops/s $\color{#35bf28}+0.89\%$
test_iql_speed[reduce-overhead-backward] 15.7873ms 15.2757ms 65.4635 Ops/s 64.1748 Ops/s $\color{#35bf28}+2.01\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.5036ms 6.3377ms 157.7856 Ops/s 157.7758 Ops/s $+0.01\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 2.0474ms 0.3271ms 3.0576 KOps/s 3.1912 KOps/s $\color{#d91a1a}-4.19\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6205ms 0.3199ms 3.1265 KOps/s 3.3223 KOps/s $\textbf{\color{#d91a1a}-5.89\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.5802ms 6.0522ms 165.2298 Ops/s 164.5411 Ops/s $\color{#35bf28}+0.42\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9992ms 0.3442ms 2.9053 KOps/s 3.3039 KOps/s $\textbf{\color{#d91a1a}-12.07\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5480ms 0.3361ms 2.9753 KOps/s 3.7075 KOps/s $\textbf{\color{#d91a1a}-19.75\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6540ms 1.3114ms 762.5563 Ops/s 720.1218 Ops/s $\textbf{\color{#35bf28}+5.89\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.4676ms 1.2424ms 804.9237 Ops/s 762.5180 Ops/s $\textbf{\color{#35bf28}+5.56\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.4887ms 6.2611ms 159.7173 Ops/s 160.3664 Ops/s $\color{#d91a1a}-0.40\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.2198ms 0.4656ms 2.1479 KOps/s 2.4002 KOps/s $\textbf{\color{#d91a1a}-10.51\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7808ms 0.4443ms 2.2507 KOps/s 2.4180 KOps/s $\textbf{\color{#d91a1a}-6.92\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.2734ms 6.1096ms 163.6777 Ops/s 166.1996 Ops/s $\color{#d91a1a}-1.52\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 2.0283ms 0.2771ms 3.6082 KOps/s 3.2329 KOps/s $\textbf{\color{#35bf28}+11.61\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.4425ms 0.2527ms 3.9580 KOps/s 2.7219 KOps/s $\textbf{\color{#35bf28}+45.41\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.5358ms 6.0538ms 165.1860 Ops/s 167.2031 Ops/s $\color{#d91a1a}-1.21\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.0168ms 0.2637ms 3.7925 KOps/s 3.8242 KOps/s $\color{#d91a1a}-0.83\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.4371ms 0.2418ms 4.1359 KOps/s 4.0282 KOps/s $\color{#35bf28}+2.67\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.6348ms 6.2429ms 160.1824 Ops/s 160.9849 Ops/s $\color{#d91a1a}-0.50\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1961ms 0.4191ms 2.3858 KOps/s 2.0951 KOps/s $\textbf{\color{#35bf28}+13.88\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8422ms 0.4022ms 2.4861 KOps/s 2.3353 KOps/s $\textbf{\color{#35bf28}+6.46\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.4659s 14.5619ms 68.6721 Ops/s 187.5024 Ops/s $\textbf{\color{#d91a1a}-63.38\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 10.2372ms 2.0640ms 484.4945 Ops/s 450.0258 Ops/s $\textbf{\color{#35bf28}+7.66\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 7.0283ms 1.2334ms 810.7342 Ops/s 858.0320 Ops/s $\textbf{\color{#d91a1a}-5.51\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 7.1078ms 5.3487ms 186.9618 Ops/s 34.3374 Ops/s $\textbf{\color{#35bf28}+444.48\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 10.6398ms 2.1319ms 469.0730 Ops/s 477.9631 Ops/s $\color{#d91a1a}-1.86\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 3.7299ms 1.1966ms 835.6829 Ops/s 887.2165 Ops/s $\textbf{\color{#d91a1a}-5.81\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.3740s 12.9656ms 77.1273 Ops/s 175.8215 Ops/s $\textbf{\color{#d91a1a}-56.13\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 8.5691ms 2.1394ms 467.4281 Ops/s 457.3223 Ops/s $\color{#35bf28}+2.21\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 8.7489ms 1.3225ms 756.1422 Ops/s 677.4137 Ops/s $\textbf{\color{#35bf28}+11.62\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 13.3743ms 12.8158ms 78.0286 Ops/s 77.7307 Ops/s $\color{#35bf28}+0.38\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 18.2258ms 16.9763ms 58.9055 Ops/s 59.2370 Ops/s $\color{#d91a1a}-0.56\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 18.6709ms 17.3926ms 57.4957 Ops/s 56.8357 Ops/s $\color{#35bf28}+1.16\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 18.2405ms 17.2765ms 57.8823 Ops/s 58.2256 Ops/s $\color{#d91a1a}-0.59\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 19.4955ms 17.4390ms 57.3426 Ops/s 57.8721 Ops/s $\color{#d91a1a}-0.92\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 18.9860ms 18.4276ms 54.2664 Ops/s 53.8182 Ops/s $\color{#35bf28}+0.83\%$

vmoens added a commit that referenced this pull request Nov 14, 2024
@vmoens
[BugFix] Remove erroneous python 3.8 compatibility classifier (#2540)
7811dea 
(cherry picked from commit 528875a)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. setup Has to do with installation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot