Configurable sparse prediction threshold #5

Job	Run time
macOS-latest-cmake-ios	2m 32s
macOS-latest-cmake	2m 50s
macOS-latest-cmake-tvos	4m 35s
macOS-latest-make	50s
macOS-latest-swift (generic/platform=macOS)	4m 33s
ubuntu-focal-make	39s
macOS-latest-swift (generic/platform=iOS)	2m 10s
macOS-latest-swift (generic/platform=tvOS)	2m 24s
ubuntu-latest-cmake	1m 52s
ubuntu-latest-cmake-mpi (mpich)	2m 15s
ubuntu-latest-cmake-mpi (libopenmpi-dev)	3m 18s
ubuntu-latest-cmake-sanitizer (ADDRESS, Debug)	6m 18s
ubuntu-latest-cmake-sanitizer (ADDRESS, Release)	6m 3s
ubuntu-latest-cmake-sanitizer (THREAD, Debug)	14m 12s
windows-latest-cmake (noavx, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX=OFF -DLLAMA_A...	31s
ubuntu-latest-cmake-sanitizer (THREAD, Release)	8m 20s
windows-latest-cmake (avx2, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DBUILD_SHARED_LIBS=ON)	1m 24s
ubuntu-latest-cmake-sanitizer (UNDEFINED, Debug)	4m 21s
windows-latest-cmake (avx, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX2=OFF -DBUILD_SH...	1m 30s
ubuntu-latest-cmake-sanitizer (UNDEFINED, Release)	5m 33s
windows-latest-cmake (avx512, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX512=ON -DBUIL...	1m 8s
windows-latest-cmake-cublas (12.2.0, cublas)	17m 12s
windows-latest-cmake (clblast, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_CLBLAST=ON -DBU...	39s
windows-latest-cmake-cublas (11.7.1, cublas)	17m 28s
windows-latest-cmake (openblas, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_BLAS=ON -DBUIL...	46s
release	0s
	1h 53m 23s

Provide feedback