Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can't send images to be analyzed to litellm models #6

Open
SonOfLope opened this issue May 2, 2024 · 1 comment
Open

Can't send images to be analyzed to litellm models #6

SonOfLope opened this issue May 2, 2024 · 1 comment

Comments

@SonOfLope
Copy link
Collaborator

SonOfLope commented May 2, 2024

When configuring a litellm that can analyze images like 'gemini-1.5-pro' or 'gemini-pro-vision' and send it an image file to be analyzed, it gets stuck into a loop trying to give an answer. Ultimately I have to restart de pod instance since the website becomes unresponsive.

Looking into it, the image file is being sent by pointing to a url :

url: file.url

I dont know if its related to hosting louis internally since it works when testing locally with the snippet code : https://litellm.vercel.app/docs/providers/gemini#sample-usage-1

@github-project-automation github-project-automation bot moved this to Todo in Louis May 2, 2024
@SonOfLope SonOfLope changed the title Cant send images to be analyzed to litellm models Can't send images to be analyzed to litellm models May 2, 2024
@SonOfLope
Copy link
Collaborator Author

related issue explaining that this is a known limitation : open-webui#1298

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Todo
Development

No branches or pull requests

1 participant