Skip to content

Commit

Permalink
Make MetadataReplacementDemo.ipynb Clearer
Browse files Browse the repository at this point in the history
Current wording suggests sentences are replaced with the window "during retrieval" whereas the replacement happens after retrieval
  • Loading branch information
sad-mathematician authored Jul 7, 2024
1 parent 8cfae0b commit 00bd7b6
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@
"\n",
"In this notebook, we use the `SentenceWindowNodeParser` to parse documents into single sentences per node. Each node also contains a \"window\" with the sentences on either side of the node sentence.\n",
"\n",
"Then, during retrieval, before passing the retrieved sentences to the LLM, the single sentences are replaced with a window containing the surrounding sentences using the `MetadataReplacementNodePostProcessor`.\n",
"Then, after retrieval, before passing the retrieved sentences to the LLM, the single sentences are replaced with a window containing the surrounding sentences using the `MetadataReplacementNodePostProcessor`.\n",
"\n",
"This is most useful for large documents/indexes, as it helps to retrieve more fine-grained details.\n",
"\n",
Expand Down

0 comments on commit 00bd7b6

Please sign in to comment.