You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It looks like Gemini context caching does not work when using Vertex AI.
Doing a cursory search, it looks like this part would need to be implemented to support Vertex AI:
The Feature
It looks like Gemini context caching does not work when using Vertex AI.
Doing a cursory search, it looks like this part would need to be implemented to support Vertex AI:
litellm/litellm/llms/vertex_ai_and_google_ai_studio/gemini/transformation.py
Line 392 in c73ce95
Motivation, pitch
Context cachin is already supported using the Gemini API and it's a good way to reduce costs.
Twitter / LinkedIn details
No response
The text was updated successfully, but these errors were encountered: