[FEAT]: Add bearer token to header for Ollama LLM Provider and UI for setting this. #2749
Labels
enhancement
New feature or request
feature request
Integration Request
Request for support of a new LLM, Embedder, or Vector database
What would you like to see?
This should be really simple, high-impact, low-hanging fruit for the Desktop and Web App!!
Please add an optional advanced setting for Ollama providers where you can specify a bearer token.
Currently, AnythingLLM does not appear to have a mechanism or user interface for setting the bearer token in the http header for Ollama LLM Providers (Ollama endpoints). Other tools like WebUI and Enchanted provide this, which is really helpful if your central Ollama infrastructure supports Ollama API keys in this way using an authenticating proxy like NGINX, Caddy, etc.
This tiny missing feature is the only thing preventing much larger adoption of AnythingLLM within our organization.
Thank you so much for your consideration!
The text was updated successfully, but these errors were encountered: