What's the best way to secure the endpoints?

[pbasov]

For LLMs I understand I can put everything behind OpenWebUI and let users manage their keys there, but for faster-whisper, it doesn't seem like owui proxies /audio/transcriptions calls through their endpoint.

I looked into a bunch of solutions like Kong and Istio, but they all seem needlessly complicated, especially when you want users to have self-service.

Relevant issue I guess: #101
But i think it doesn't have to be built into the endpoints, a reverse-proxy is fine.

[pbasov]

One solution is to have LiteLLM, but they have paywalled the SSO feature unfortunately.