Speed up integration tests for LLM applications from seconds to milliseconds. Record once, replay forever with Sequa, the open-source LLM cassette library.
No reviews yetBe the first to leave a review for Sequa
Maker
📌
👋 Hi Product Hunt!
We're excited to introduce Sequa.
Over the past few months, we've been building AI applications and kept running into the same engineering challenge: reproducing and debugging AI behavior. Traditional tools weren't designed for probabilistic systems, and we wanted a simpler way to record and replay AI executions during development.
That's what led us to build Sequa.
Today, Sequa helps developers:
📼 Record AI executions
🔁 Replay them deterministically
🐍 Integrate easily with Python applications
🔌 Work with OpenAI today, with additional integrations actively being expanded
This is an early release, and we're building it in the open. We'd genuinely appreciate your feedback on the developer experience, integrations you'd like to see, and how you're currently testing AI applications.
If you give Sequa a try, we'd love to hear your thoughts—whether it's a feature request, bug report, or idea.
Thanks for checking it out! 🚀
Report
Love the concept of recorded cassettes for LLM tests — would save so much flaky test pain. One thing I'd love to see is deterministic seeding or a "mock mode" that injects the recorded response but still lets you assert on token counts or latency budgets. That way you're not just replaying blind but can catch performance regressions too.
Report
Maker
@nevzato5qw Thanks! Really appreciate the thoughtful feedback.
You're spot on, recording and replaying is just one part of the testing workflow. We've been thinking about making the replay layer more configurable, where you can replay recorded responses while still validating execution metadata like latency, token usage, and cost budgets.
That would make Sequa useful not only for deterministic functional tests but also for regression and performance testing. Definitely something we'd like to explore as the project evolves.
Love the concept of recorded cassettes for LLM tests — would save so much flaky test pain. One thing I'd love to see is deterministic seeding or a "mock mode" that injects the recorded response but still lets you assert on token counts or latency budgets. That way you're not just replaying blind but can catch performance regressions too.
@nevzato5qw Thanks! Really appreciate the thoughtful feedback.
You're spot on, recording and replaying is just one part of the testing workflow. We've been thinking about making the replay layer more configurable, where you can replay recorded responses while still validating execution metadata like latency, token usage, and cost budgets.
That would make Sequa useful not only for deterministic functional tests but also for regression and performance testing. Definitely something we'd like to explore as the project evolves.
Thanks for the suggestion!