Ollama/ Local LLM Support

[tomtom215]

Hello,

This is an awesome project, thank you for sharing!

I was thinking that a lot more people (and potential contributors) would try this project out if they could use a local LLM api server like Ollama. It would also help with knowledge graph use-cases with sensitive data requirements as well as quick, local experimentation.

For example, here is how their embedding api endpoint looks https://ollama.com/blog/embedding-models

[634750802]

Hi @tomtom215, thanks for your feedback

We already support Ollama on main branch, please wait for our next docker release #419