You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I noticed that every message I add to the conversation increases the token input by about 2,000 tokens. I checked the memory and saw that the full system prompt is being saved with each message.
Is that necessary? It seems like a waste of tokens.
The text was updated successfully, but these errors were encountered:
I noticed that every message I add to the conversation increases the token input by about 2,000 tokens. I checked the memory and saw that the full system prompt is being saved with each message.
Is that necessary? It seems like a waste of tokens.
The text was updated successfully, but these errors were encountered: