Replies: 1 comment 4 replies
-
If you want to use the ttl function for the cache, you need to use the redis dependency. example: https://github.com/zilliztech/GPTCache/blob/main/examples/eviction/distributed_eviction.py |
Beta Was this translation helpful? Give feedback.
4 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
As the title suggest, i would like to know how can i invalidate some cache entries because my AI Agent returns live data that change quite often, therefore cached answers are not viable anymore after a certain amount of time.
Beta Was this translation helpful? Give feedback.
All reactions