Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Will KoboldCpp consider adding RAG functionality in the future? #1239

Open
addisjeams opened this issue Nov 26, 2024 · 0 comments
Open

Will KoboldCpp consider adding RAG functionality in the future? #1239

addisjeams opened this issue Nov 26, 2024 · 0 comments

Comments

@addisjeams
Copy link

Will KoboldCpp consider adding RAG functionality in the future?

Hello, I am using KoboldCpp for creating long stories.
Now I have found a small issue, which requires manually updating the key in the world info, which is a very large workload. Because as the story unfolds, the original content corresponding to the key has become outdated.

May I ask if we are considering introducing RAG or opening up an interface that allows us to inject the content of other RAGs into the context of each submission?

Alternatively, if you have any good ideas, please let me know. Thank you.

I am currently using 32K-128K for context, but I still feel it is not enough.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant