Only store messages if they get a response from the model
did:plc:sfjxpxxyvewb2zlxwoz2vduw opened this Nov 4, 2025 0 comments
did:plc:sfjxpxxyvewb2zlxwoz2vduw opened Nov 4, 2025
Right now if the model fails to respond, then the conversation context just has the user asking questions with no response. Waste of tokens. Plus it'd also contribute to the user's daily message quota
No activity yet.