Skip to content

Commit

Permalink
Merge pull request #1191 from qdrant/maddie-qdrant-patch-3
Browse files Browse the repository at this point in the history
Update semantic-cache-ai-data-retrieval.md
  • Loading branch information
davidmyriel authored Sep 23, 2024
2 parents ef3bd4c + b135fc0 commit 4099c6a
Showing 1 changed file with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -39,9 +39,9 @@ In this blog and video, we will walk you through how to use Qdrant to implement

Semantic cache is increasingly used in Retrieval-Augmented Generation (RAG) applications. In RAG, when a user asks a question, we embed it and search our vector database, either by using keyword, semantic, or hybrid search methods. The matched context is then passed to a Language Model (LLM) along with the prompt and user question for response generation.

Qdrant is recommended for setting up semantic cache as semantically evaluates the response. When semantic cache is implemented, we store common questions and their corresponding answers in a key-value cache. This way, when a user asks a question, we can retrieve the response from the cache if it already exists.
Qdrant is recommended for setting up semantic cache as semantically [evaluates](https://qdrant.tech/rag/rag-evaluation-guide/) the response. When semantic cache is implemented, we store common questions and their corresponding answers in a key-value cache. This way, when a user asks a question, we can retrieve the response from the cache if it already exists.

**Diagram:** Semantic cache improves RAG by directly retrieving stored answers to the user. **Follow along with the gif** and see how semantic cache stores and retrieves answers.
**Diagram:** Semantic cache improves [RAG](https://qdrant.tech/rag/rag-evaluation-guide/) by directly retrieving stored answers to the user. **Follow along with the gif** and see how semantic cache stores and retrieves answers.

![Alt Text](/blog/semantic-cache-ai-data-retrieval/semantic-cache.gif)

Expand Down

0 comments on commit 4099c6a

Please sign in to comment.