[Distributed] Fix new token's shape #1606

Job	Run time
test-advanced-mps-macos / macos-job	9m 40s
test-gguf-mps-macos / macos-job	9m 48s
test-quantization-mps-macos / macos-job	9m 36s
test-readme-mps-macos / macos-job	1m 42s
	30m 46s

Provide feedback