This is for the advanced chat. I’m curious cause it will feel like I’ve been messaging an AI for hours and no memories or summaries were made. (I’m not saying it has been actual hours, I’m just saying that it’s been awhile)
Hii, ACC doesn’t use a fixed message count to start summarization. Instead, it estimates how long the whole prompt is (which includes the chat), and summarization happens if it exceeds a fixed number of tokens (currently 5200). On average, I think that should be somewhere around 3,750 to 3,900 words, if memory serves right.
An aside for anyone interested: using message count to kick summarization is something I experimented with on my fork, but that has it’s own problems as well, as a lot of the time summarization triggers without the conversation having all that much “information density”. I assume that’s why this was never implemented, though I could be wrong. Anyway, what I had to wind up doing is make the
messagesBeforeSummaryslightly bigger based on the number of summaries, which isn’t perfect obviously, but made it more-or-less workable.Source: months of tinkering with the code ^^
Thank you! This was incredibly helpful :)
For hours? Stupid question: did you enable the long-term memory? just asking bc I forget that sometimes… and “hours” of writing is quite a long time.
Yes. And I was asking for both memory and summary. And as it says at the end of the post, it wasn’t actual hours. It just feels like that sometimes lol
