Ensure that templates don't cause CL issues during reload #503

Job	Run time
Build on ubuntu-latest - 17	12m 47s
Build on ubuntu-latest - 17	12m 47s
Test on ubuntu-latest - 21	10m 19s
Test on ubuntu-latest - 21	10m 19s
azure-openai native tests	13m 36s
azure-openai native tests	4m 12s
bam native tests	4m 2s
bam native tests	4m 2s
devui native tests	1m 10s
devui native tests	1m 10s
hugging-face native tests	4m 10s
hugging-face native tests	4m 10s
mistralai native tests	4m 17s
mistralai native tests	4m 17s
multiple-providers native tests	4m 11s
multiple-providers native tests	4m 11s
ollama native tests	5m 18s
ollama native tests	5m 18s
openai native tests	4m 40s
openai native tests	4m 40s
simple-ollama native tests	4m 21s
simple-ollama native tests	4m 21s
	2h 8m 18s

Provide feedback