-
Notifications
You must be signed in to change notification settings - Fork 392
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DLL initialization routine failed #1293
Comments
It looks like the Processor Intel(R) Celeron(R) N4500 is a low-end CPU that does not support AVX or AVX2 instruction sets used - thus will be quite slow. Can you try running it with the Failsafe Mode (Old CPU) option. If you are running it from the command prompt, you would add the flag Also you would probably need to use a smaller model, otherwise it will be too slow. |
It has worked! Thank you. Do you have any recommendations for better models to use? |
How much RAM do you have? You can maybe try this: https://huggingface.co/NousResearch/Hermes-3-Llama-3.2-3B-GGUF/blob/main/Hermes-3-Llama-3.2-3B.Q4_K_M.gguf |
I have 8 gigabytes of RAM. |
Yeah, then that model should suit you. |
Considering this machine is so limited both on the CPU and RAM side you can also consider trying KoboldCpp on colab with https://koboldai.org/colabcpp |
Hello!
I was attempting to use KoboldCpp to connect to SillyTavern but I ran into a problem. Sadly, I am not acquainted enough with coding or anything of the sort to fix it myself.
Here is the text I was presented with upon pressing the "Launch" button:
And my computer specifications, if needed:
Processor Intel(R) Celeron(R) N4500 @ 1.10GHz / Windows 11 Home Version 24H2
Thank you!
The text was updated successfully, but these errors were encountered: