Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DLL initialization routine failed #1293

Open
NappoTapo opened this issue Dec 31, 2024 · 6 comments
Open

DLL initialization routine failed #1293

NappoTapo opened this issue Dec 31, 2024 · 6 comments

Comments

@NappoTapo
Copy link

Hello!
I was attempting to use KoboldCpp to connect to SillyTavern but I ran into a problem. Sadly, I am not acquainted enough with coding or anything of the sort to fix it myself.
Here is the text I was presented with upon pressing the "Launch" button:

image

And my computer specifications, if needed:
Processor Intel(R) Celeron(R) N4500 @ 1.10GHz / Windows 11 Home Version 24H2

Thank you!

@LostRuins
Copy link
Owner

It looks like the Processor Intel(R) Celeron(R) N4500 is a low-end CPU that does not support AVX or AVX2 instruction sets used - thus will be quite slow.

Can you try running it with the Failsafe Mode (Old CPU) option. If you are running it from the command prompt, you would add the flag --failsafe

Also you would probably need to use a smaller model, otherwise it will be too slow.

@NappoTapo
Copy link
Author

It has worked! Thank you. Do you have any recommendations for better models to use?

@LostRuins
Copy link
Owner

@NappoTapo
Copy link
Author

I have 8 gigabytes of RAM.

@LostRuins
Copy link
Owner

Yeah, then that model should suit you.

@henk717
Copy link

henk717 commented Jan 4, 2025

Considering this machine is so limited both on the CPU and RAM side you can also consider trying KoboldCpp on colab with https://koboldai.org/colabcpp

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants