Add more optimizers + open up config settings #324

Job	Run time
pip (windows-latest, cpu)	50s
pip (ubuntu-latest, cpu)	20s
pip (windows-latest, directml)	51s
conda (ubuntu-latest, nvidia)	8m 31s
conda (ubuntu-latest, cpu)	8m 50s
conda (macos-latest, nvidia)	7s
conda (macos-latest, cpu)	7s
conda (windows-latest, nvidia)	14m 36s
conda (windows-latest, cpu)	6h 0m 8s
conda (ubuntu-latest, rocm)	8m 54s
conda (windows-latest, directml)	16m 23s
	6h 59m 37s

Provide feedback