Sacha MORARD

Sacha MORARD

Co founder Edgee
All activity
Edgee compresses prompts before they reach LLM providers and reduces token costs by up to 50%. Same code, fewer tokens, lower bills.
Edgee
EdgeeThe AI Gateway that TL;DR tokens
Sacha MORARDstarted a discussion

Token Compression for LLMs: How to reduce context size without losing accuracy

Hey, I'm Sacha, co-founder at @Edgee Over the last few months, we've been working on a problem we kept seeing in production AI systems: LLM costs don't scale linearly with usage, they scale with context. As teams add RAG, tool calls, long chat histories, memory, and guardrails, prompts become huge… and token spend quickly becomes the main bottleneck. So we built a token compression layer...