Launched this week
BotGauge
The trust layer for your agents
678 followers
The trust layer for your agents
678 followers
AI agents don't just generate answers anymore. They take actions, call tools, and access real data. BotGauge helps engineering teams find where agents break before users do. Run adaptive red-team attacks and evals, catch security and behavioral failures, and replay every issue with full traces. Turn failures into regression tests, continuously retest as your agents evolve, and monitor their behavior in production. One reliability layer from development to deployment.
Excited to try out red-teaming. Stress testing the AI agent against real attack patterns before attackers to find the gaps sounds interesting.
@monish_k_s Appreciate it! The best part is hearing what people find. If you run it, tell us the one attack that caught you off guard and we’ll dig into it with you.
Really excited for users to start using this
@subham_sharma11 Thank you! We’re excited too. Can’t wait to hear what you think once you try it.
A friend of mine runs a booking agent. A user talked it into changing a trip without asking anyone. Scary how easy it was.
@om_prakash49 Yikes, that’s the scary kind of failure, because nothing looks broken. The agent did exactly what it was asked, just for the wrong person. Honestly it’s the same class of thing red-teaming is built for, so if your friend ever wants to throw it at that booking agent, I’d love to hear what it turns up
How do I get my agent layer into the platform? Mine needs a macOS computer to run.
@alchemist_studio Good question. Can you tell us a bit more about how your agent runs, like whether it’s driven through an API, a CLI, or a desktop app? That’ll tell us the best way to hook it up, and we’ll walk you through it.
Really love this. It's something we will definitely look into as we roll out AI chat in our app in the coming months, as it's exactly the type of testing and safeguards we need.
@billmaroulis Thank you, that’s great to hear! Rolling out chat is the perfect time to test. Sign up and try it on your app’s chat before launch, and tell us what it finds.
The trace is what makes a failed eval useful for me. Being able to replay the same tool calls should make it easier to check whether a fix holds.
@oleksii_sekundant Yes, exactly. A fix you can’t replay is mostly a guess. Running the same tool calls again is the only real way to know the hole is actually closed and not just hidden.
“So we built an attacker” — great line 😄 I like it
@alexkhlystova Haha thanks! Glad it landed. 😄