Deepchecks Monitoring
Open Source Monitoring for AI & ML
Start new thread
Shir Chorev

Deepchecks Testing Package - Open source tool for testing & validating your model & data

by
Deepchecks Monitoring
•
Find problems in your ML models and data before it’s too late!
With just a few lines of code, Deepchecks creates elaborate reports about your data’s integrity, distributions, and your model’s performance.

Add a comment

Replies

Best
Meir Maor
Evaluated deepchecks shortly after launch. A ton of useful checks on models and data, some are easy to implement, some less so, but the real value IMHO is having a lot of these easily packaged. You can try checks you wouldn't have otherwise prioritiesed and only look deeper if they find an issue. Note however the AGPL license and verify if you can use free version or need some commercial agreement.
philip tannor
Maker
@meir_maor thanks, and glad you see the value in the package, and like the way, it is built! Licensing is always a complex issue, in our case we were looking for a solution that would enable free and open usage for any ML practitioner that's building their own model, but that would still enable us to avoid cases like the Elastic/Amazon licensing case. Based on numerous user interviews, I've learned that many of the concerns that are usually relevant to AGPL licenses don't apply to this case, since Deepchecks isn't used in the actual production code, but is only used to test the data/models before they are productionized. In any case, we'd love to collaborate on a business level with companies that are building ML platforms, and of course, this would include a designated license. On a different note, if there are any teams working on an interesting use case that are in need of a different license, please reach out, and let's see if we can find a solution.
Chidi-Bernard Emmanuel
Wonderful. I'm excited to try this out!
Shir Chorev
Maker
@chidi_bernard_emmanuel Thank you so much, we'd love to hear your feedback once you have it!
Ganesh Chavan
Helpful! congratulations on the launch!
philip tannor
Maker
@ganesh_chavan18 thank you so much! And would love to hear your feedback once you have some...
Moshe Bublil
Great tool and kick off. Would this be relevant for the use case of real time monitoring of autonomous vehicles?
Shir Chorev
Maker
Hi @moshe_bublil, and thanks for the positive feedback! This is definitely a relevant use case. As you may have seen, the Computer Vision module of Deepchecks is still in Beta. However, even the existing features would provide some important value for a this real time AV use case. There is still a hardware/runtime complexity issue that need some careful thought, but we’ve had discussions about this use case with relevant AV teams in the past. If you have a specific use case in mind - let’s discuss!
Bohdan Romaniuk
It seems to me that for a quick check and building an MVP is an awesome solution
Shir Chorev
Maker
@bidkaromaniuk Would be happy to hear your usage scenarios and any additional suggestions! Link for opening new issues: https://github.com/deepchecks/de... (⭐️ to support)
IHOR SHAMIN
Congratulations on your launch! Good luck!
philip tannor
Maker
@igor_shamin thanks! Much appreciated...
Dani Avitz
The testing package looks very comprehensive, and I see it achieved 1.8K GitHub stars in no time! Well done.
philip tannor
Maker
@dani_avitz1 thanks! And I can't tell you how much we appreciate the support we've been receiving from the community
Achalesh Lakhotiya
Congratulations on the product launch @shirch and the team! 🤩 Would love to give it a shot.
Shir Chorev
Maker
@achalesh_lakhotiya Happy to hear, looking forward for your feedback!!
Ayushi Sharma
Nailed it, fantastic!
Shir Chorev
Maker
@ayushi_sharma9 Thanks! We've seen various use cases in academic areas, we would be happy to collaborate! (feel free to reach out via linkedin or in our community 🤓)
Liz Cohen
Excited to support this. Well done guys!
philip tannor
Maker
@liz_cohen thanks, you rock!
First
Previous
•••
345
Next
Last