Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate thread restart techniques #1

Open
phact opened this issue Sep 7, 2024 · 0 comments
Open

Investigate thread restart techniques #1

phact opened this issue Sep 7, 2024 · 0 comments

Comments

@phact
Copy link
Owner

phact commented Sep 7, 2024

Today we share the same thread across all llm requests in a session (this translates to as long as the server is up, server restarts, new thread).

Sometimes the llm gets stuck in loops (buggy code in the context) and it struggles to get out of it. Alternatively having history of previous improvements and mistakes could be helpful.

Investigate into when it makes sense to start a new thread or maybe allow the user to control this in the UI.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant