We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
We need to add "keep_alive" option to ollama requests to be able to control model lifecycle in memory.
https://github.com/ollama/ollama/blob/main/docs/faq.md#how-do-i-keep-a-model-loaded-in-memory-or-make-it-unload-immediately
Relates to s-kostyaev/ellama#160
The text was updated successfully, but these errors were encountered:
We can't use :default-chat-non-standard-params here because this option at the top level of request object.
:default-chat-non-standard-params
Sorry, something went wrong.
I think we could probably use it if we specially handle this particular variable in making the request. I'll take a look at this soon.
No branches or pull requests
We need to add "keep_alive" option to ollama requests to be able to control model lifecycle in memory.
https://github.com/ollama/ollama/blob/main/docs/faq.md#how-do-i-keep-a-model-loaded-in-memory-or-make-it-unload-immediately
Relates to s-kostyaev/ellama#160
The text was updated successfully, but these errors were encountered: