Petr Brzek

Langtail 1.0 - The low-code platform for testing AI apps

by•
LLM testing made easy with a spreadsheet-like interface. Score tests with natural language, pattern matching, or code. Optimize LLM apps by experimenting with models, parameters, and prompts. Gain insights from test results and analytics.

Add a comment

Replies

Best
Saurav Jain
Saurav from Apify here, congratulations on the launch. Looking forward to see the growth <3
Petr Brzek
Thanks @sauain. We love Apify. We use it to scrape everything. šŸ˜€
Matija Sosic
Congrats on the launch! A big fan of spreadsheets so this hits just right :)
Petr Brzek
Thanks. Spreadsheets are really the universal tool for everything. :)
Yigit Ihlamur
Nice product, solving a real pain point! How does integrate with a product in production? Is there a sdk that we put in our codebase in certain segments and it listens the outputs?
Petr Brzek
@yigit For integration, we have SDK or OpenAPI. You can also use us as a Proxy - all data goes through us, or asynchronously - you send data from your codebase to Langtail. Additionally, you can use us just for development if you want to develop prompts and test them in the UI environment.
Ryan Hefner
I’m one of the engineers on this project! Very excited to launch 1.0 after months of working on it. Our team has thought deeply (and talked to other companies much larger than us) about testing LLM-based apps. AMA.
Tomas Rychlik
Hey! I'm Tomas, co-founder and CTO of Langtail. šŸš€ Quick update on our LLM provider support! During beta launch, we only supported OpenAI. Now with Langtail 1.0, we've added all major providers: - Anthropic Claude - Google Gemini (includes video support!) - Open Source models like LLama on Groq - And more! šŸ¤– This means more flexibility for you to test and compare different models in one place. Looking forward to hearing your thoughts! šŸ’¬
Samuel Bissegger
Awesome product you've built with Langtail, @petrbrzek and Team! I think this has great potential as building apps based on LLMs is not that trivial. I hope this launch boosts you!
Ryan Hefner
@samuel_bissegger It's deceptively tricky to build a production-grade app using LLMs. Thank you so much for your support, Samuel!
Johan Cutych
Testing AI powered apps is really challenging. Excited to try this!
Petr Brzek
That's true, best practices are missing and the whole community is figuring out how to do it properly.
Maru Rivera
Favourite thing: How the cost to performance metrics. Absolute Banger
Ryan Hefner
@maru_rivera1 Thanks Maru!
Huzaifa Shoukat
Huge congrats to the Langtail team on the 1.0 launch! I love how you've simplified LLM testing with a spreadsheet-like interface - who wouldn't want to tame AI complexity with a familiar feel? Quick question: Can you share an example of a surprising insight or optimization that a beta tester achieved using Langtail's analytics?
Martin Duris
@ihuzaifashoukat Hi! Thanks for support. There are several ways to enhance the consistency of LLM responses through testing, especially when you're evaluating multiple models to optimize for performance and cost. Not all models deliver consistent results for specific requirements. You can explore our case study with our customer, Deepnote, to see how they improved their AI features using Langtail. Check it out here: https://langtail.com/customers/d.... Let me know if you have any further questions. Martin
Tom
That sounds Amazing!
Ryan Hefner
@troubletony Thanks for your support, Tom! Are you building an LLM-powered app?