Ollama & Docker
#1573
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
{{ message }}
-
Hey,
I'm running ollama locally on my Mac for gpu support when I run liteLLM locally it automatically finds ollama and lists all the models. When I run liteLLM through docker-compose this doesn't happen. Is there something I need to add to the docker-compose file for this to work? Or will I need to manually list them in the liteLLM config file?
Thanks!
Beta Was this translation helpful? Give feedback.
All reactions