You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Sometimes we get more result text back than there is model context, especially if the context is set to a low number. This results in the llm not adhering to the requested answer structure. Which results in parsing errors.
Describe the solution you'd like
Limit the amount of context we use with db / websearch results.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Sometimes we get more result text back than there is model context, especially if the context is set to a low number. This results in the llm not adhering to the requested answer structure. Which results in parsing errors.
Describe the solution you'd like
Limit the amount of context we use with db / websearch results.
The text was updated successfully, but these errors were encountered: