Skip to content

Commit

Permalink
Merge pull request #469 from superlinked/revert-468-update-rag-comm-s…
Browse files Browse the repository at this point in the history
…ys-article

Revert "Update rag-application-communication-system.md"
  • Loading branch information
robertdhayanturner authored Aug 26, 2024
2 parents 986fa22 + 25d081f commit 2e7fc7d
Showing 1 changed file with 1 addition and 6 deletions.
7 changes: 1 addition & 6 deletions docs/articles/rag-application-communication-system.md
Original file line number Diff line number Diff line change
Expand Up @@ -95,14 +95,12 @@ In practical terms:

In this time of LLMs, older information retrieval methods and indicators continue to hold a lot of unrealized value, especially now that it's possible to generate/extract many key data features at scale. Jo Kristian Bergum from Vespa, for example, has [convincingly demonstrated](https://blog.vespa.ai/improving-retrieval-with-llm-as-a-judge/) how classic info retrieval evaluation design and metrics (precision at k, recall) can be effectively repurposed using emerging practices in AI, such as LLM-as-a-Judge - grounded on a small but scalable relevant dataset. Intensive data work that would have been available only to large scale organizations is now scalable with far fewer resources.

<div align="left">
> &nbsp;
>**GOING HYBRID**
>- *Indexation*: traditional keyword matching + modern embedding-based similarity
>- *Searching*: keyword-based search + vector search
>- *Evaluation*: precision at k, recall + LLM-as-a-judge
> &nbsp;
</div>
Generative AI within a RAG communication system shouldn't be looking to replace the classic approaches of retrieval evaluation; it should instead reshape their logistics to take full advantage of them.

Expand All @@ -113,12 +111,9 @@ A proper RAG communication system should treat data no longer as a passive refer
1. continuously transformed and reshaped to better fit the retrieval objective, and
2. constantly circulated across different flows

<div align="left">
> &nbsp;
> A good RAG comm system includes:
> &nbsp;&nbsp;&nbsp;&nbsp;bad data + classifiers + synthetic data curation
> A good RAG comm system includes: bad data + classifiers + synthetic data curation
> &nbsp;
</div>
### 3.1 You need bad data

Expand Down

0 comments on commit 2e7fc7d

Please sign in to comment.