Remove numpy requirement #10365

Job	Run time
build-linux (x86, linux.12xlarge, static, gcc)	17m 27s
build-linux (x86, linux.12xlarge, static, clang)	16m 41s
build-linux (x86, linux.12xlarge, shared, gcc)	17m 36s
build-macos (macos-13, static)	10m 54s
build-linux (x86, linux.12xlarge, shared, clang)	16m 51s
build-macos (macos-13, shared)	12m 5s
build-bazel (x86, linux.12xlarge, gcc)	9m 6s
build-bazel (x86, linux.12xlarge, clang)	8m 12s
build-windows (windows-2022, static)	12m 21s
build-windows (windows-2022, shared)	12m 44s
	2h 13m 57s

Provide feedback