Feature Update: Rolling Conversation Summaries — Cut Chat Costs Without Losing Context

We built a feature to solve a problem most AI apps eventually run into:

The longer the conversation, the more you keep paying to resend the entire chat history — over and over.

Blog here (https://www.mnexium.com/blogs/chat-summarization)

Docs here (https://www.mnexium.com/docs#summarize)

That “token tax” adds up fast.
In the blog, we walked through a realistic scenario:

• 40 messages per conversation

• ~200 tokens per message

• 1,000 daily active users

• 3 conversations per user, per day

Without summarization, the same history gets re-sent repeatedly — totaling:

➡️ 492M tokens per day
➡️ ~14.7B tokens per month
➡️ ≈ $36,900/month (at $2.50 / 1M tokens)

We shipped Conversation Summaries.

Older segments of a chat get automatically compressed into concise summaries, while the most recent turns stay fully intact — preserving accuracy, tone, and state.

With summarization turned on, that same scenario drops to:

➡️ 36M tokens per day
➡️ ≈ $2,700/month
➡️ ~93% cost reduction

Completely runs in the background — meaning:

✔️ conversations stay long
✔️ latency doesn’t change
✔️ users don’t see “summary artifacts”
✔️ you stop paying for repeated context

We also included configurable modes:

• Light — minimal compression

• Balanced — smart middle ground

• Aggressive — maximize savings

• Custom — tune thresholds & token limits yourself

summaries keep long conversations affordable, while memories preserve important facts across sessions (preferences, goals, profile info). You get continuity inside the chat and persistence beyond it.

If you're building AI chats and want to stay scalable, the post breaks down how it works and when to use each mode.