LLM testing made easy with a spreadsheet-like interface. Score tests with natural language, pattern matching, or code. Optimize LLM apps by experimenting with models, parameters, and prompts. Gain insights from test results and analytics.
Nice product, solving a real pain point! How does integrate with a product in production? Is there a sdk that we put in our codebase in certain segments and it listens the outputs?
@yigit For integration, we have SDK or OpenAPI. You can also use us as a Proxy - all data goes through us, or asynchronously - you send data from your codebase to Langtail. Additionally, you can use us just for development if you want to develop prompts and test them in the UI environment.
Iām one of the engineers on this project! Very excited to launch 1.0 after months of working on it.
Our team has thought deeply (and talked to other companies much larger than us) about testing LLM-based apps. AMA.
Hey! I'm Tomas, co-founder and CTO of Langtail. š
Quick update on our LLM provider support!
During beta launch, we only supported OpenAI. Now with Langtail 1.0, we've added all major providers:
- Anthropic Claude
- Google Gemini (includes video support!)
- Open Source models like LLama on Groq
- And more! š¤
This means more flexibility for you to test and compare different models in one place.
Looking forward to hearing your thoughts! š¬
Awesome product you've built with Langtail, @petrbrzek and Team! I think this has great potential as building apps based on LLMs is not that trivial. I hope this launch boosts you!
Huge congrats to the Langtail team on the 1.0 launch! I love how you've simplified LLM testing with a spreadsheet-like interface - who wouldn't want to tame AI complexity with a familiar feel? Quick question: Can you share an example of a surprising insight or optimization that a beta tester achieved using Langtail's analytics?
@ihuzaifashoukat Hi! Thanks for support. There are several ways to enhance the consistency of LLM responses through testing, especially when you're evaluating multiple models to optimize for performance and cost. Not all models deliver consistent results for specific requirements. You can explore our case study with our customer, Deepnote, to see how they improved their AI features using Langtail. Check it out here: https://langtail.com/customers/d.... Let me know if you have any further questions. Martin
Replies
Crawlee
Macaly
Open SaaS
Macaly
Vela Partners
Macaly
Langtail
Macaly
Univerbal
Langtail
VEED
Macaly
Langtail
Macaly
š” Edit Slides with PowerPPTX AI
Langtail