Model loading question #166
Answered
by
LostRuins
Zyril-8204
asked this question in
Q&A
-
|
Hey there, gonna tag someone directly in this question here as they would 100% know for sure. @LostRuins. All the documentation I have read talks about pointing to a model.bin file. However I am seeing more and more models popup with the model.safetensors file format. Can/would Koboldcpp be able to work and support pointing and reading from the safetensors file format rather than a bin file format? Is this something I should request upstream in llama? |
Beta Was this translation helpful? Give feedback.
Answered by
LostRuins
May 16, 2023
Replies: 1 comment
-
|
Can't load safetensors directly. You'd have to convert it which should be possible |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
Zyril-8204
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Can't load safetensors directly. You'd have to convert it which should be possible