Skip to content

Commit e963e16

Browse files
authored
Remove model size guidance from FAQ
Removed redundant information about model sizes in the WebUI. Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent 1e9b115 commit e963e16

File tree

1 file changed

+1
-3
lines changed

1 file changed

+1
-3
lines changed

docs/content/docs/faq.md

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -44,8 +44,6 @@ Model sizes vary significantly depending on the model and quantization level:
4444
- Use SSD storage for better performance
4545
- Consider the model size relative to your system RAM - models larger than your RAM may not run efficiently
4646

47-
The WebUI shows model sizes in the Models tab to help you choose appropriate models for your system.
48-
4947
### Benchmarking LocalAI and llama.cpp shows different results!
5048

5149
LocalAI applies a set of defaults when loading models with the llama.cpp backend, one of these is mirostat sampling - while it achieves better results, it slows down the inference. You can disable this by setting `mirostat: 0` in the model config file. See also the advanced section ({{%relref "docs/advanced/advanced-usage" %}}) for more information and [this issue](https://github.com/mudler/LocalAI/issues/2780).
@@ -89,4 +87,4 @@ This typically happens when your prompt exceeds the context size. Try to reduce
8987

9088
### I'm getting a 'SIGILL' error, what's wrong?
9189

92-
Your CPU probably does not have support for certain instructions that are compiled by default in the pre-built binaries. If you are running in a container, try setting `REBUILD=true` and disable the CPU instructions that are not compatible with your CPU. For instance: `CMAKE_ARGS="-DGGML_F16C=OFF -DGGML_AVX512=OFF -DGGML_AVX2=OFF -DGGML_FMA=OFF" make build`
90+
Your CPU probably does not have support for certain instructions that are compiled by default in the pre-built binaries. If you are running in a container, try setting `REBUILD=true` and disable the CPU instructions that are not compatible with your CPU. For instance: `CMAKE_ARGS="-DGGML_F16C=OFF -DGGML_AVX512=OFF -DGGML_AVX2=OFF -DGGML_FMA=OFF" make build`

0 commit comments

Comments
 (0)