You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When the user clicks the blue double-arrow button to generate a new variant response, it looks like the memory and lore queries are repeated. That seems a bit inefficient and expensive. Can the previous memory/lore results be reused instead?
The text was updated successfully, but these errors were encountered:
Not sure that this makes sense in all/most cases - the user may be retrying because (whether they know or not) the queries were bad. The memory queries are very cheap anyway (compared to bot responses - EDIT: actually this may be wrong, can't remember how much context memory-query-generations use. they should be cheaper - but not sure by how much), so it'd only be worth it to save the user some time (but again, not sure it would make sense in all/most cases due to aforementioned reason)
When the user clicks the blue double-arrow button to generate a new variant response, it looks like the memory and lore queries are repeated. That seems a bit inefficient and expensive. Can the previous memory/lore results be reused instead?
The text was updated successfully, but these errors were encountered: