NotHotDog
Automate testing for LLM Applications
Start new thread

NotHotDog (Alpha) - Test your LLM powered APIs & AI agents

by
•
NotHotDog is a testing tool for LLM Powered APIs - suitable both for voice and text apis.Test latency, record, store voice/string test cases and simplify API testing with NotHotDog - the Postman for LLM powered APIs.

Add a comment

Replies

Best
Congratulation on the launch, looks like a cool product!
Maker
Thank you so much!
Sounds like another attempt to ride the AI wave, isn't there already a ton of tools like Postman and others that do this, what's really new here 🧐
Maker
It's an attempt to help the folks building AI applications, especially those building complex voice agents requiring custom test criteria :) We'd love to have you try it out and see the difference :D
OK, so we're going back to the "Not Hotdog" joke, huh, look doesn't everybody just use Postman already for this kinda stuff, seems a bit redundant, unless you're really into novelty apps, maybe focus a bit more on what sets it apart from other tools like Swagger?
Maker
Great points. Its most centric to the APIs which are not served by Postman, insomnia or Kong. - We are making it easier who are building APIs on top of LLMs - We are adding the checks so instead of manually going through response, you can just run the evaluate tests and have a UI for it. - There is context matching which tells you how much of the output is matching with the expected output - And definitely you can record the voices directly, instead of saving the voice and uploading which happens on other api testing apps. If you are using LLMs beneath your apis, this will be far more useful to you.
Congrats on launch. Any plan to build voice chat bot testing module?
Maker
Thank you :) Great question - we already do have a voice chat bot testing module !
This is a fascinating tool! It really seems like it could streamline the testing process. What inspired the unique name "NotHotDog" :D
Maker
We aim to simplify testing and save developers a lot of time! We're big fans of Silicon Valley ;) :D
Great working in same domain to evaluate llm , nice to connect with you.
First
Previous
123