Michael Seibel

Evidently AI - Open-source evaluations and observability for LLM apps

by•
Evidently is an open-source framework to evaluate, test and monitor AI-powered apps.

šŸ“š 100+ built-in checks, from classification to RAG.
🚦 Both offline evals and live monitoring.
šŸ›  Easily add custom metrics and LLM judges.

Add a comment

Replies

Best
Mihail Eric
Cracked team solving one of the hardest problems in LLMs today. If anyone is going to solve it, it's them.
Elena Samuylova
@mihail_eric Thanks for the support!
Mona Rakibe
Amazing team with a fantastic product that's solving real-need. Congrats team Evidently.
Elena Samuylova
@mona_rakibe Thanks for your support, Mona! ā¤ļø
Shafeek V P
nice
Mark Abramovitz
Congrats on the launch! Have you found that Evidently's suggestions are pretty consistent across solutions, or does it really depend on the application at hand? For example, does it always recommend ChatGPT over Claude (or vice versa), or does it depend on the use case? (And if you can share two use cases where the answer is different, that'd be super cool!)
Sauske Uchiha
How does Evidently AI handle complex datasets?