Fix for random sampler recompilations for incomplete batches #367

Job	Run time
Dependency Review	7s
CodeQL Scan	3m 12s
Calculate Tests To Trigger	4s
Test / gsm8k_small_g3_tp1	8m 55s
Test / gsm8k_small_g3_tp2	7m 26s
Test / gsm8k_small_g2_tp1	8m 29s
Test / gsm8k_small_g2_tp2	8m 4s
Test / gsm8k_large_g3_tp2	28m 59s
Test / gsm8k_large_g2_tp4	26m 41s
Test / gsm8k_small_g3_tp1_fp8	12m 29s
Test / gsm8k_small_g3_tp2_fp8	6m 53s
Test / gsm8k_small_g3_tp1_mss	7m 36s
Test / gsm8k_small_g2_tp1_mss	6m 10s
Test / gsm8k_small_g3_tp2_mss	4m 49s
Test / gsm8k_small_g2_tp2_mss	8m 32s
Test / gsm8k_small_g2_tp1_spec_decode	6m 1s
Test / gsm8k_small_g2_tp1_mlp_spec_decode	5m 31s
Test / gsm8k_small_g2_tp1_medusa_spec_decode	4m 26s
Test / gsm8k_small_g2_tp1_eagle_spec_decode	5m 26s
Test / test_llama_lora	4m 22s
Test / test_multilora	4m 21s
Test / test_long_context	5m 27s
	2h 54m 0s

Provide feedback