You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Today we share the same thread across all llm requests in a session (this translates to as long as the server is up, server restarts, new thread).
Sometimes the llm gets stuck in loops (buggy code in the context) and it struggles to get out of it. Alternatively having history of previous improvements and mistakes could be helpful.
Investigate into when it makes sense to start a new thread or maybe allow the user to control this in the UI.
The text was updated successfully, but these errors were encountered:
Today we share the same thread across all llm requests in a session (this translates to as long as the server is up, server restarts, new thread).
Sometimes the llm gets stuck in loops (buggy code in the context) and it struggles to get out of it. Alternatively having history of previous improvements and mistakes could be helpful.
Investigate into when it makes sense to start a new thread or maybe allow the user to control this in the UI.
The text was updated successfully, but these errors were encountered: