Add tests for out of order with checkpointing #2106

Job	Run time
generate-matrix / generate	4s
pytorch/data / manywheel-py3_9-cpu	3m 46s
pytorch/data / upload / manywheel-py3_9-cpu	26s
	4m 16s

Provide feedback