Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: enable weaviate usage in codegate #128

Merged
merged 11 commits into from
Dec 2, 2024
Merged

feat: enable weaviate usage in codegate #128

merged 11 commits into from
Dec 2, 2024

Conversation

yrobla
Copy link
Contributor

@yrobla yrobla commented Nov 29, 2024

Closes: #63

@yrobla yrobla requested review from jhrozek and lukehinds and removed request for jhrozek November 29, 2024 10:12
@yrobla yrobla force-pushed the issue-63 branch 10 times, most recently from 9446ad2 to 610f925 Compare November 29, 2024 14:47
@yrobla yrobla force-pushed the issue-63 branch 3 times, most recently from 0f1997e to 078f99a Compare November 29, 2024 15:23
Comment on lines +11 to +18
from src.codegate.utils.utils import generate_vector_string


class CodegateContextRetriever(PipelineStep):
"""
Pipeline step that adds a context message to the completion request when it detects
the word "codegate" in the user message.
"""
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Question from @lukehinds on the duplicated PR #133:

Would like to understand this a little better, does it mean we only report on MAL pkgs if someone says 'codegate', what does the word trigger?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jhrozek as you proposed that system... I believe that the codegate word Will be prepended automatically ?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was just an example. We need to figure out when do we trigger the RAG. With the Go implementation we did that on all conversations that had no code snippets, which is an easy implementation. We could do that for a start, but the downside was that the RAG was called also if the user didn't ask about any package. For example if they asked "give me an example SQL query" the RAG would match all packages with the word SQL in it. It would be nice to work together with @ptelang to figure out how to fine tune this.

@yrobla yrobla requested a review from aponcedeleonch December 2, 2024 11:25
@yrobla yrobla merged commit 466d495 into main Dec 2, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Implementation of VectorDB within codegate code
3 participants