[Tests] Fix windows tests

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2219

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• Rebase your PRs: Unstable CUDA signal in CI caused by cudnn 9 update

❌ 3 New Failures, 1 Unrelated Failure

As of commit 68c7749 with merge base c67ad59 ():

NEW FAILURES - The following jobs have failed:

• Habitat Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t a60037724595b3e48efe6c44ccf7a589b7655cfbd443af8458def69c924a6a2e /exec failed with exit code 139
• Unit-tests on Linux / tests-optdeps (3.10, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 965fa5b531ef1c4436d0a7f26cd28470f2619afcdcfc70c134f4d756d17a86de /exec failed with exit code 1
• Unit-tests on Windows / unittests-cpu / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 128

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job (gh) (trunk failure)
  test/test_transforms.py::TestVecNorm::test_state_dict_vecnorm

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1107s	59.7425ms	16.7385 Ops/s	17.9391 Ops/s	$\textbf{\color{#d91a1a}-6.69\%}$
test_sync	30.6261ms	30.1994ms	33.1132 Ops/s	31.6983 Ops/s	$\color{#35bf28}+4.46\%$
test_async	55.0746ms	27.0190ms	37.0110 Ops/s	36.7764 Ops/s	$\color{#35bf28}+0.64\%$
test_simple	0.4454s	0.3866s	2.5869 Ops/s	2.6191 Ops/s	$\color{#d91a1a}-1.23\%$
test_transformed	0.5324s	0.5281s	1.8934 Ops/s	1.8654 Ops/s	$\color{#35bf28}+1.50\%$
test_serial	1.3045s	1.2551s	0.7968 Ops/s	0.7723 Ops/s	$\color{#35bf28}+3.17\%$
test_parallel	1.1224s	1.0606s	0.9429 Ops/s	0.9252 Ops/s	$\color{#35bf28}+1.90\%$
test_step_mdp_speed[True-True-True-True-True]	0.1460ms	21.3608μs	46.8146 KOps/s	46.0315 KOps/s	$\color{#35bf28}+1.70\%$
test_step_mdp_speed[True-True-True-True-False]	44.4720μs	13.1030μs	76.3185 KOps/s	75.3768 KOps/s	$\color{#35bf28}+1.25\%$
test_step_mdp_speed[True-True-True-False-True]	46.1460μs	12.6481μs	79.0634 KOps/s	78.2732 KOps/s	$\color{#35bf28}+1.01\%$
test_step_mdp_speed[True-True-True-False-False]	51.2760μs	7.7634μs	128.8090 KOps/s	129.7756 KOps/s	$\color{#d91a1a}-0.74\%$
test_step_mdp_speed[True-True-False-True-True]	54.4510μs	22.6697μs	44.1118 KOps/s	42.9891 KOps/s	$\color{#35bf28}+2.61\%$
test_step_mdp_speed[True-True-False-True-False]	0.2827ms	14.5752μs	68.6097 KOps/s	68.8385 KOps/s	$\color{#d91a1a}-0.33\%$
test_step_mdp_speed[True-True-False-False-True]	33.9630μs	13.8768μs	72.0627 KOps/s	71.5416 KOps/s	$\color{#35bf28}+0.73\%$
test_step_mdp_speed[True-True-False-False-False]	29.3140μs	8.9420μs	111.8317 KOps/s	111.1652 KOps/s	$\color{#35bf28}+0.60\%$
test_step_mdp_speed[True-False-True-True-True]	56.4450μs	24.0275μs	41.6190 KOps/s	41.3389 KOps/s	$\color{#35bf28}+0.68\%$
test_step_mdp_speed[True-False-True-True-False]	43.3800μs	15.6872μs	63.7464 KOps/s	63.2773 KOps/s	$\color{#35bf28}+0.74\%$
test_step_mdp_speed[True-False-True-False-True]	40.7960μs	13.9295μs	71.7903 KOps/s	71.3912 KOps/s	$\color{#35bf28}+0.56\%$
test_step_mdp_speed[True-False-True-False-False]	46.1160μs	8.9871μs	111.2709 KOps/s	111.3431 KOps/s	$\color{#d91a1a}-0.06\%$
test_step_mdp_speed[True-False-False-True-True]	54.9420μs	24.9437μs	40.0903 KOps/s	39.3390 KOps/s	$\color{#35bf28}+1.91\%$
test_step_mdp_speed[True-False-False-True-False]	46.1560μs	16.8263μs	59.4308 KOps/s	59.0664 KOps/s	$\color{#35bf28}+0.62\%$
test_step_mdp_speed[True-False-False-False-True]	56.1350μs	14.8824μs	67.1936 KOps/s	65.9455 KOps/s	$\color{#35bf28}+1.89\%$
test_step_mdp_speed[True-False-False-False-False]	30.2360μs	10.1552μs	98.4716 KOps/s	98.7988 KOps/s	$\color{#d91a1a}-0.33\%$
test_step_mdp_speed[False-True-True-True-True]	58.4590μs	23.9910μs	41.6823 KOps/s	40.7848 KOps/s	$\color{#35bf28}+2.20\%$
test_step_mdp_speed[False-True-True-True-False]	50.8850μs	15.6072μs	64.0730 KOps/s	63.1782 KOps/s	$\color{#35bf28}+1.42\%$
test_step_mdp_speed[False-True-True-False-True]	43.8620μs	15.9917μs	62.5325 KOps/s	61.4285 KOps/s	$\color{#35bf28}+1.80\%$
test_step_mdp_speed[False-True-True-False-False]	32.5710μs	10.1604μs	98.4216 KOps/s	97.9631 KOps/s	$\color{#35bf28}+0.47\%$
test_step_mdp_speed[False-True-False-True-True]	59.0900μs	25.2774μs	39.5610 KOps/s	39.3284 KOps/s	$\color{#35bf28}+0.59\%$
test_step_mdp_speed[False-True-False-True-False]	40.0650μs	16.8978μs	59.1792 KOps/s	58.8959 KOps/s	$\color{#35bf28}+0.48\%$
test_step_mdp_speed[False-True-False-False-True]	46.9970μs	17.1989μs	58.1434 KOps/s	57.5851 KOps/s	$\color{#35bf28}+0.97\%$
test_step_mdp_speed[False-True-False-False-False]	34.6150μs	11.4591μs	87.2667 KOps/s	88.0968 KOps/s	$\color{#d91a1a}-0.94\%$
test_step_mdp_speed[False-False-True-True-True]	62.1660μs	26.5972μs	37.5979 KOps/s	37.1654 KOps/s	$\color{#35bf28}+1.16\%$
test_step_mdp_speed[False-False-True-True-False]	46.7170μs	18.5562μs	53.8902 KOps/s	54.6812 KOps/s	$\color{#d91a1a}-1.45\%$
test_step_mdp_speed[False-False-True-False-True]	49.1010μs	17.2886μs	57.8416 KOps/s	57.5479 KOps/s	$\color{#35bf28}+0.51\%$
test_step_mdp_speed[False-False-True-False-False]	33.6120μs	11.3971μs	87.7415 KOps/s	87.4054 KOps/s	$\color{#35bf28}+0.38\%$
test_step_mdp_speed[False-False-False-True-True]	38.2010μs	27.7415μs	36.0470 KOps/s	35.1241 KOps/s	$\color{#35bf28}+2.63\%$
test_step_mdp_speed[False-False-False-True-False]	42.4190μs	19.2985μs	51.8175 KOps/s	51.5813 KOps/s	$\color{#35bf28}+0.46\%$
test_step_mdp_speed[False-False-False-False-True]	48.7110μs	18.2138μs	54.9034 KOps/s	54.3308 KOps/s	$\color{#35bf28}+1.05\%$
test_step_mdp_speed[False-False-False-False-False]	39.8140μs	12.4201μs	80.5145 KOps/s	80.5970 KOps/s	$\color{#d91a1a}-0.10\%$
test_values[generalized_advantage_estimate-True-True]	10.0460ms	9.8223ms	101.8088 Ops/s	105.4378 Ops/s	$\color{#d91a1a}-3.44\%$
test_values[vec_generalized_advantage_estimate-True-True]	36.9982ms	33.2762ms	30.0515 Ops/s	28.6250 Ops/s	$\color{#35bf28}+4.98\%$
test_values[td0_return_estimate-False-False]	0.2216ms	0.1703ms	5.8732 KOps/s	5.9955 KOps/s	$\color{#d91a1a}-2.04\%$
test_values[td1_return_estimate-False-False]	27.6419ms	24.2205ms	41.2874 Ops/s	42.6755 Ops/s	$\color{#d91a1a}-3.25\%$
test_values[vec_td1_return_estimate-False-False]	35.2230ms	33.4096ms	29.9315 Ops/s	28.6191 Ops/s	$\color{#35bf28}+4.59\%$
test_values[td_lambda_return_estimate-True-False]	48.9215ms	34.9771ms	28.5901 Ops/s	29.8783 Ops/s	$\color{#d91a1a}-4.31\%$
test_values[vec_td_lambda_return_estimate-True-False]	34.7582ms	33.2948ms	30.0348 Ops/s	28.5875 Ops/s	$\textbf{\color{#35bf28}+5.06\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512]	10.2135ms	8.5400ms	117.0964 Ops/s	119.8998 Ops/s	$\color{#d91a1a}-2.34\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	2.1843ms	1.9081ms	524.0773 Ops/s	494.8188 Ops/s	$\textbf{\color{#35bf28}+5.91\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.4324ms	0.3520ms	2.8412 KOps/s	2.8474 KOps/s	$\color{#d91a1a}-0.22\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	42.9306ms	42.1647ms	23.7165 Ops/s	21.7653 Ops/s	$\textbf{\color{#35bf28}+8.96\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	3.6477ms	3.0317ms	329.8484 Ops/s	330.2540 Ops/s	$\color{#d91a1a}-0.12\%$
test_dqn_speed	1.7236ms	1.3304ms	751.6485 Ops/s	741.2514 Ops/s	$\color{#35bf28}+1.40\%$
test_ddpg_speed	3.6839ms	2.8452ms	351.4709 Ops/s	351.8005 Ops/s	$\color{#d91a1a}-0.09\%$
test_sac_speed	10.4870ms	8.4268ms	118.6684 Ops/s	119.4845 Ops/s	$\color{#d91a1a}-0.68\%$
test_redq_speed	14.7880ms	13.5808ms	73.6331 Ops/s	75.6756 Ops/s	$\color{#d91a1a}-2.70\%$
test_redq_deprec_speed	14.7720ms	13.3822ms	74.7261 Ops/s	75.4910 Ops/s	$\color{#d91a1a}-1.01\%$
test_td3_speed	16.5001ms	8.4138ms	118.8523 Ops/s	119.4590 Ops/s	$\color{#d91a1a}-0.51\%$
test_cql_speed	38.8952ms	36.7503ms	27.2107 Ops/s	27.3458 Ops/s	$\color{#d91a1a}-0.49\%$
test_a2c_speed	8.5560ms	7.5024ms	133.2908 Ops/s	133.9772 Ops/s	$\color{#d91a1a}-0.51\%$
test_ppo_speed	8.6587ms	7.8128ms	127.9950 Ops/s	128.4697 Ops/s	$\color{#d91a1a}-0.37\%$
test_reinforce_speed	7.3569ms	6.6922ms	149.4280 Ops/s	149.4343 Ops/s	$-0.00\%$
test_iql_speed	33.5420ms	32.9467ms	30.3521 Ops/s	30.4179 Ops/s	$\color{#d91a1a}-0.22\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	5.2977ms	3.5629ms	280.6675 Ops/s	284.8537 Ops/s	$\color{#d91a1a}-1.47\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.9910ms	0.5017ms	1.9934 KOps/s	2.0015 KOps/s	$\color{#d91a1a}-0.41\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.6571ms	0.4805ms	2.0814 KOps/s	2.1126 KOps/s	$\color{#d91a1a}-1.48\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	4.3679ms	3.5700ms	280.1142 Ops/s	283.7130 Ops/s	$\color{#d91a1a}-1.27\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.0098ms	0.4946ms	2.0218 KOps/s	2.0334 KOps/s	$\color{#d91a1a}-0.57\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.6489ms	0.4745ms	2.1074 KOps/s	2.1251 KOps/s	$\color{#d91a1a}-0.83\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	2.3099ms	1.7066ms	585.9551 Ops/s	590.5859 Ops/s	$\color{#d91a1a}-0.78\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.9595ms	1.6143ms	619.4818 Ops/s	625.2784 Ops/s	$\color{#d91a1a}-0.93\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	5.5106ms	3.6749ms	272.1142 Ops/s	273.7851 Ops/s	$\color{#d91a1a}-0.61\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.1049s	0.7025ms	1.4235 KOps/s	1.4236 KOps/s	$-0.01\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.8178ms	0.5913ms	1.6912 KOps/s	1.7086 KOps/s	$\color{#d91a1a}-1.02\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	3.7723ms	3.6036ms	277.5012 Ops/s	284.6088 Ops/s	$\color{#d91a1a}-2.50\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.0761ms	0.5111ms	1.9566 KOps/s	1.9818 KOps/s	$\color{#d91a1a}-1.27\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.6132ms	0.4878ms	2.0499 KOps/s	2.0992 KOps/s	$\color{#d91a1a}-2.35\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.9901ms	3.6673ms	272.6802 Ops/s	281.6926 Ops/s	$\color{#d91a1a}-3.20\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.7009ms	0.5111ms	1.9564 KOps/s	2.0211 KOps/s	$\color{#d91a1a}-3.20\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	4.0334ms	0.4921ms	2.0322 KOps/s	2.1127 KOps/s	$\color{#d91a1a}-3.81\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	4.4276ms	3.8663ms	258.6467 Ops/s	276.1739 Ops/s	$\textbf{\color{#d91a1a}-6.35\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.2726ms	0.6367ms	1.5705 KOps/s	1.6122 KOps/s	$\color{#d91a1a}-2.58\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.7604ms	0.6052ms	1.6523 KOps/s	1.6862 KOps/s	$\color{#d91a1a}-2.01\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1249s	6.1414ms	162.8302 Ops/s	127.8137 Ops/s	$\textbf{\color{#35bf28}+27.40\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	17.0297ms	12.6218ms	79.2280 Ops/s	79.8858 Ops/s	$\color{#d91a1a}-0.82\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	1.5873ms	1.0921ms	915.6677 Ops/s	963.8352 Ops/s	$\color{#d91a1a}-5.00\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1128s	5.9728ms	167.4254 Ops/s	179.9377 Ops/s	$\textbf{\color{#d91a1a}-6.95\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	15.3123ms	12.6539ms	79.0269 Ops/s	80.4345 Ops/s	$\color{#d91a1a}-1.75\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	3.8489ms	1.1124ms	898.9660 Ops/s	962.6204 Ops/s	$\textbf{\color{#d91a1a}-6.61\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1023s	5.8270ms	171.6163 Ops/s	175.7321 Ops/s	$\color{#d91a1a}-2.34\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	0.1061s	14.4925ms	69.0012 Ops/s	69.0845 Ops/s	$\color{#d91a1a}-0.12\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	3.6578ms	1.2388ms	807.2419 Ops/s	839.0438 Ops/s	$\color{#d91a1a}-3.79\%$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1213s	0.1180s	8.4752 Ops/s	8.6000 Ops/s	$\color{#d91a1a}-1.45\%$
test_sync	0.1052s	0.1029s	9.7173 Ops/s	9.5104 Ops/s	$\color{#35bf28}+2.17\%$
test_async	0.1946s	94.8987ms	10.5376 Ops/s	10.1173 Ops/s	$\color{#35bf28}+4.15\%$
test_single_pixels	0.1288s	0.1284s	7.7909 Ops/s	7.8961 Ops/s	$\color{#d91a1a}-1.33\%$
test_sync_pixels	84.4281ms	81.2584ms	12.3064 Ops/s	12.3898 Ops/s	$\color{#d91a1a}-0.67\%$
test_async_pixels	0.1523s	66.7713ms	14.9765 Ops/s	14.8123 Ops/s	$\color{#35bf28}+1.11\%$
test_simple	0.9160s	0.8611s	1.1613 Ops/s	1.2487 Ops/s	$\textbf{\color{#d91a1a}-7.00\%}$
test_transformed	1.1384s	1.0892s	0.9181 Ops/s	0.9311 Ops/s	$\color{#d91a1a}-1.39\%$
test_serial	2.5325s	2.4789s	0.4034 Ops/s	0.3869 Ops/s	$\color{#35bf28}+4.26\%$
test_parallel	2.4332s	2.3646s	0.4229 Ops/s	0.4170 Ops/s	$\color{#35bf28}+1.41\%$
test_step_mdp_speed[True-True-True-True-True]	77.0420μs	33.6692μs	29.7007 KOps/s	29.3600 KOps/s	$\color{#35bf28}+1.16\%$
test_step_mdp_speed[True-True-True-True-False]	39.2310μs	19.8660μs	50.3372 KOps/s	50.5980 KOps/s	$\color{#d91a1a}-0.52\%$
test_step_mdp_speed[True-True-True-False-True]	37.0710μs	19.2228μs	52.0214 KOps/s	50.3730 KOps/s	$\color{#35bf28}+3.27\%$
test_step_mdp_speed[True-True-True-False-False]	46.1710μs	11.2172μs	89.1486 KOps/s	87.3811 KOps/s	$\color{#35bf28}+2.02\%$
test_step_mdp_speed[True-True-False-True-True]	65.5110μs	34.9009μs	28.6525 KOps/s	28.1690 KOps/s	$\color{#35bf28}+1.72\%$
test_step_mdp_speed[True-True-False-True-False]	40.8510μs	21.7581μs	45.9598 KOps/s	45.6526 KOps/s	$\color{#35bf28}+0.67\%$
test_step_mdp_speed[True-True-False-False-True]	66.4510μs	20.6397μs	48.4504 KOps/s	47.4144 KOps/s	$\color{#35bf28}+2.18\%$
test_step_mdp_speed[True-True-False-False-False]	37.3410μs	13.1880μs	75.8264 KOps/s	74.8370 KOps/s	$\color{#35bf28}+1.32\%$
test_step_mdp_speed[True-False-True-True-True]	62.8720μs	37.5427μs	26.6363 KOps/s	26.7867 KOps/s	$\color{#d91a1a}-0.56\%$
test_step_mdp_speed[True-False-True-True-False]	40.3010μs	23.4601μs	42.6255 KOps/s	42.2680 KOps/s	$\color{#35bf28}+0.85\%$
test_step_mdp_speed[True-False-True-False-True]	45.6310μs	20.5232μs	48.7254 KOps/s	47.3106 KOps/s	$\color{#35bf28}+2.99\%$
test_step_mdp_speed[True-False-True-False-False]	39.1310μs	13.2394μs	75.5322 KOps/s	75.0660 KOps/s	$\color{#35bf28}+0.62\%$
test_step_mdp_speed[True-False-False-True-True]	63.5520μs	38.6615μs	25.8655 KOps/s	25.3076 KOps/s	$\color{#35bf28}+2.20\%$
test_step_mdp_speed[True-False-False-True-False]	58.5910μs	25.7142μs	38.8890 KOps/s	39.2042 KOps/s	$\color{#d91a1a}-0.80\%$
test_step_mdp_speed[True-False-False-False-True]	44.5810μs	22.5603μs	44.3257 KOps/s	43.5816 KOps/s	$\color{#35bf28}+1.71\%$
test_step_mdp_speed[True-False-False-False-False]	35.1610μs	15.1978μs	65.7988 KOps/s	65.9396 KOps/s	$\color{#d91a1a}-0.21\%$
test_step_mdp_speed[False-True-True-True-True]	81.0220μs	37.2596μs	26.8387 KOps/s	26.4834 KOps/s	$\color{#35bf28}+1.34\%$
test_step_mdp_speed[False-True-True-True-False]	53.0320μs	23.3283μs	42.8663 KOps/s	41.7859 KOps/s	$\color{#35bf28}+2.59\%$
test_step_mdp_speed[False-True-True-False-True]	46.7210μs	24.0522μs	41.5762 KOps/s	39.5755 KOps/s	$\textbf{\color{#35bf28}+5.06\%}$
test_step_mdp_speed[False-True-True-False-False]	34.5600μs	15.1976μs	65.7999 KOps/s	66.3613 KOps/s	$\color{#d91a1a}-0.85\%$
test_step_mdp_speed[False-True-False-True-True]	59.0020μs	38.9929μs	25.6457 KOps/s	25.8671 KOps/s	$\color{#d91a1a}-0.86\%$
test_step_mdp_speed[False-True-False-True-False]	52.8510μs	25.5597μs	39.1241 KOps/s	38.4557 KOps/s	$\color{#35bf28}+1.74\%$
test_step_mdp_speed[False-True-False-False-True]	53.9920μs	26.3332μs	37.9749 KOps/s	36.2122 KOps/s	$\color{#35bf28}+4.87\%$
test_step_mdp_speed[False-True-False-False-False]	50.8110μs	16.9936μs	58.8457 KOps/s	59.2188 KOps/s	$\color{#d91a1a}-0.63\%$
test_step_mdp_speed[False-False-True-True-True]	62.7110μs	40.6547μs	24.5974 KOps/s	24.3076 KOps/s	$\color{#35bf28}+1.19\%$
test_step_mdp_speed[False-False-True-True-False]	51.7510μs	27.1236μs	36.8683 KOps/s	36.1885 KOps/s	$\color{#35bf28}+1.88\%$
test_step_mdp_speed[False-False-True-False-True]	51.1610μs	26.1556μs	38.2327 KOps/s	37.4492 KOps/s	$\color{#35bf28}+2.09\%$
test_step_mdp_speed[False-False-True-False-False]	42.3310μs	17.0746μs	58.5665 KOps/s	58.6538 KOps/s	$\color{#d91a1a}-0.15\%$
test_step_mdp_speed[False-False-False-True-True]	58.0810μs	42.7380μs	23.3984 KOps/s	22.9350 KOps/s	$\color{#35bf28}+2.02\%$
test_step_mdp_speed[False-False-False-True-False]	53.8110μs	29.4003μs	34.0133 KOps/s	33.2874 KOps/s	$\color{#35bf28}+2.18\%$
test_step_mdp_speed[False-False-False-False-True]	50.2910μs	27.6188μs	36.2072 KOps/s	34.8582 KOps/s	$\color{#35bf28}+3.87\%$
test_step_mdp_speed[False-False-False-False-False]	43.8010μs	18.6696μs	53.5630 KOps/s	53.2102 KOps/s	$\color{#35bf28}+0.66\%$
test_values[generalized_advantage_estimate-True-True]	25.4746ms	24.3376ms	41.0886 Ops/s	41.9035 Ops/s	$\color{#d91a1a}-1.94\%$
test_values[vec_generalized_advantage_estimate-True-True]	90.5844ms	2.7152ms	368.3017 Ops/s	350.8309 Ops/s	$\color{#35bf28}+4.98\%$
test_values[td0_return_estimate-False-False]	0.1014ms	66.1353μs	15.1205 KOps/s	15.3999 KOps/s	$\color{#d91a1a}-1.81\%$
test_values[td1_return_estimate-False-False]	57.2753ms	55.7489ms	17.9376 Ops/s	18.2270 Ops/s	$\color{#d91a1a}-1.59\%$
test_values[vec_td1_return_estimate-False-False]	1.3772ms	1.0887ms	918.5676 Ops/s	925.8669 Ops/s	$\color{#d91a1a}-0.79\%$
test_values[td_lambda_return_estimate-True-False]	91.0896ms	89.0405ms	11.2308 Ops/s	11.6429 Ops/s	$\color{#d91a1a}-3.54\%$
test_values[vec_td_lambda_return_estimate-True-False]	1.3231ms	1.0873ms	919.7272 Ops/s	929.1257 Ops/s	$\color{#d91a1a}-1.01\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	25.9712ms	25.6026ms	39.0586 Ops/s	40.7081 Ops/s	$\color{#d91a1a}-4.05\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	0.9658ms	0.7279ms	1.3738 KOps/s	1.4012 KOps/s	$\color{#d91a1a}-1.96\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.7598ms	0.6757ms	1.4798 KOps/s	1.4594 KOps/s	$\color{#35bf28}+1.40\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	1.5507ms	1.4772ms	676.9635 Ops/s	684.0015 Ops/s	$\color{#d91a1a}-1.03\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	0.7632ms	0.7033ms	1.4219 KOps/s	1.4694 KOps/s	$\color{#d91a1a}-3.23\%$
test_dqn_speed	1.6451ms	1.4467ms	691.2510 Ops/s	687.4928 Ops/s	$\color{#35bf28}+0.55\%$
test_ddpg_speed	3.3112ms	2.9458ms	339.4631 Ops/s	331.6095 Ops/s	$\color{#35bf28}+2.37\%$
test_sac_speed	8.6729ms	8.2857ms	120.6902 Ops/s	118.1299 Ops/s	$\color{#35bf28}+2.17\%$
test_redq_speed	12.4163ms	10.5881ms	94.4460 Ops/s	85.8655 Ops/s	$\textbf{\color{#35bf28}+9.99\%}$
test_redq_deprec_speed	12.0553ms	11.1294ms	89.8524 Ops/s	87.5738 Ops/s	$\color{#35bf28}+2.60\%$
test_td3_speed	17.1992ms	8.3193ms	120.2023 Ops/s	118.9881 Ops/s	$\color{#35bf28}+1.02\%$
test_cql_speed	26.5929ms	25.7006ms	38.9096 Ops/s	39.1800 Ops/s	$\color{#d91a1a}-0.69\%$
test_a2c_speed	5.7530ms	5.4970ms	181.9175 Ops/s	175.5883 Ops/s	$\color{#35bf28}+3.60\%$
test_ppo_speed	6.1567ms	5.9439ms	168.2406 Ops/s	167.7770 Ops/s	$\color{#35bf28}+0.28\%$
test_reinforce_speed	4.8395ms	4.5918ms	217.7814 Ops/s	215.4031 Ops/s	$\color{#35bf28}+1.10\%$
test_iql_speed	20.0237ms	19.3665ms	51.6355 Ops/s	50.5464 Ops/s	$\color{#35bf28}+2.15\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	4.8329ms	4.6367ms	215.6701 Ops/s	214.8833 Ops/s	$\color{#35bf28}+0.37\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.3467ms	0.5921ms	1.6888 KOps/s	1.4604 KOps/s	$\textbf{\color{#35bf28}+15.64\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.7598ms	0.5703ms	1.7536 KOps/s	1.7269 KOps/s	$\color{#35bf28}+1.54\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	4.8429ms	4.6136ms	216.7489 Ops/s	216.8918 Ops/s	$\color{#d91a1a}-0.07\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.2744ms	0.5897ms	1.6958 KOps/s	1.6740 KOps/s	$\color{#35bf28}+1.30\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.8671ms	0.5703ms	1.7535 KOps/s	1.7534 KOps/s	$+0.00\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	4.7158ms	2.0707ms	482.9337 Ops/s	477.9613 Ops/s	$\color{#35bf28}+1.04\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	2.1559ms	1.9483ms	513.2557 Ops/s	500.6014 Ops/s	$\color{#35bf28}+2.53\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	4.8792ms	4.7499ms	210.5296 Ops/s	208.8333 Ops/s	$\color{#35bf28}+0.81\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.9021ms	0.7176ms	1.3935 KOps/s	1.3730 KOps/s	$\color{#35bf28}+1.49\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	70.0841ms	0.7569ms	1.3212 KOps/s	1.4014 KOps/s	$\textbf{\color{#d91a1a}-5.72\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	4.8152ms	4.6161ms	216.6316 Ops/s	215.0312 Ops/s	$\color{#35bf28}+0.74\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.7007ms	0.5883ms	1.6998 KOps/s	1.6574 KOps/s	$\color{#35bf28}+2.56\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.7238ms	0.5719ms	1.7486 KOps/s	1.7354 KOps/s	$\color{#35bf28}+0.76\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	4.8638ms	4.5901ms	217.8625 Ops/s	214.6570 Ops/s	$\color{#35bf28}+1.49\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.4882ms	0.5829ms	1.7154 KOps/s	1.6820 KOps/s	$\color{#35bf28}+1.99\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.7067ms	0.5671ms	1.7633 KOps/s	1.7592 KOps/s	$\color{#35bf28}+0.23\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	4.9214ms	4.7509ms	210.4864 Ops/s	209.0286 Ops/s	$\color{#35bf28}+0.70\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.8212ms	0.7170ms	1.3947 KOps/s	1.3823 KOps/s	$\color{#35bf28}+0.90\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.8683ms	0.6956ms	1.4376 KOps/s	1.4409 KOps/s	$\color{#d91a1a}-0.23\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1270s	7.3463ms	136.1239 Ops/s	100.8296 Ops/s	$\textbf{\color{#35bf28}+35.00\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	17.8555ms	15.6884ms	63.7415 Ops/s	61.9567 Ops/s	$\color{#35bf28}+2.88\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	2.5737ms	1.3611ms	734.7198 Ops/s	754.3323 Ops/s	$\color{#d91a1a}-2.60\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1207s	7.2680ms	137.5903 Ops/s	137.5382 Ops/s	$\color{#35bf28}+0.04\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	0.1307s	18.0663ms	55.3516 Ops/s	62.3633 Ops/s	$\textbf{\color{#d91a1a}-11.24\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	2.4918ms	1.2883ms	776.2280 Ops/s	754.0551 Ops/s	$\color{#35bf28}+2.94\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1170s	7.2995ms	136.9950 Ops/s	135.8878 Ops/s	$\color{#35bf28}+0.81\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	18.6117ms	15.8583ms	63.0583 Ops/s	62.1396 Ops/s	$\color{#35bf28}+1.48\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	2.6642ms	1.4617ms	684.1358 Ops/s	688.1530 Ops/s	$\color{#d91a1a}-0.58\%$