How to run with a specific backend? #10898
AngryPenguinPL
started this conversation in
General
Replies: 2 comments 1 reply
-
|
I would like if the various bankends could be dlopen'd, would make packaging easier for Linux distros. One could install additional libraries for other backends if they feel the need to do so. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
@AngryPenguinPL please take a look at #10497 |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Oh yes sorry, cool :) |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I wonder if there is an option to run llama.cpp with a specific backend?
That is, I have llama compiled in a combined cpu as well as vulkan and opencl.
Can I add some variable to the cli to force the use of a specific backend?
Beta Was this translation helpful? Give feedback.
All reactions