Skip to content

Commit

Permalink
Make MetadataReplacementDemo.ipynb Clearer (#14612)
Browse files Browse the repository at this point in the history
Current wording suggests sentences are replaced with the window "during retrieval" whereas the replacement happens after retrieval
  • Loading branch information
sad-mathematician authored Jul 7, 2024
1 parent 8cfae0b commit 04b79b8
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@
"\n",
"In this notebook, we use the `SentenceWindowNodeParser` to parse documents into single sentences per node. Each node also contains a \"window\" with the sentences on either side of the node sentence.\n",
"\n",
"Then, during retrieval, before passing the retrieved sentences to the LLM, the single sentences are replaced with a window containing the surrounding sentences using the `MetadataReplacementNodePostProcessor`.\n",
"Then, after retrieval, before passing the retrieved sentences to the LLM, the single sentences are replaced with a window containing the surrounding sentences using the `MetadataReplacementNodePostProcessor`.\n",
"\n",
"This is most useful for large documents/indexes, as it helps to retrieve more fine-grained details.\n",
"\n",
Expand Down

0 comments on commit 04b79b8

Please sign in to comment.