Clemens Rawert

Langfuse 2.0 - the open source LLM engineering platform

Langfuse is the open source LLM Engineering Platform. It provides observability, tracing, evaluations, prompt management, playground and metrics to debug and improve LLM apps. Langfuse is open. It works with any model, framework and you can export all data.

Add a comment

Replies

Best
Clemens Rawert
Giveaway: Sign up for Langfuse stickers here: https://langfuse.com/stickers we'll send these in the coming weeks!
Marc Klingen
@clemo_sf I want some 🪢🪢🪢
Sebastian Schüller
@clemo_sf @marc_klingen @max_deichmann congrats on the launch! It's awesome to follow your journey which is truly lightspeedy. 🔥
Marc Klingen
@clemo_sf @max_deichmann @sebastian_schuller thanks for your excitement and support, really appreciate it ❤️
Roman Martirosyan
The prompt management and tracing features are particularly intriguing. What measures have you taken to ensure data security and privacy, especially since this is a platform that interacts with potentially sensitive information?
Marc Klingen
@r_martirosyan data security and privacy is extremely important to us as many traces in Langfuse contain PII or valuable IP of our customers. Short summary: - US / data residency options - Professional penetration test to ensure our interfaces are safe - Following security best practices - GDPR, ISO 27001, and soon SOC 2 Type 2 compliance (pending) Find out more information here https://langfuse.com/security and feel free to reach out to me or security@langfuse.com if you have any questions.
Felix Vemmer
Congrats 👏 on the launch! Excited to try some of these new features!
Marc Klingen
@felix_vemmer thank you! list of all the latest releases: https://langfuse.com/changelog let me know if you have any feedback!
Aqib Ansari
Really happy with the product. It's very intuitive - Traces work very well for Agentic Workflows - Scores is another great feature to help us create datasets for finetuning - Plus, looking forward to your new eval feature!
Marc Klingen
@aqib_ansari thanks Aqib, appreciate your continuous product feedback a lot! It really helps us build the best product and continuously learn what your team needs to build the best agents 🙏
Jean Kaddour
This team ships faster than ⚡
Clemens Rawert
@jean_kaddour thank you, Jean! Likewise with sevn!
Marc Klingen
@jean_kaddour thanks, Jean, means a lot!
Dan
🔌 Plugged in
We love to use Langfuse to build our RAG systems and get the visibility into what prompts actually hitting the LLM! Btw, the new decorate is awesome
Marc Klingen
@dan_meier1 thanks, the decorator is for sure the biggest upgrade to the Langfuse developer experience in Python! We wrote a more technical blog post on it here: https://langfuse.com/blog/2024-0...
Niklas Hölterhoff
Love the new features! Great job on shipping so fast!
Marc Klingen
thanks @nhoelterhofflangdock, you are an inspiration! shipping is all we do, follow along here: https://langfuse.com/changelog
Anastasia Chakileva
Congrats on the launch! I'm curious about how Langfuse handles scaling, especially with the growing volume of events and users. Can you elaborate on the scaling strategies you've implemented to ensure smooth performance as you scale?
Marc Klingen
@anastasia_chakileva_ we currently scale out our application, on Google Cloud Run and Vercel. We closely measure capacity and performance and this setup scales really well. We are currently working on v3.0 of Langfuse which will include some infrastructure changes to make Langfuse even more scalable, support larger traces with videos/images, and faster dashboard performance.
Robert Lukoshko
best LLM engineering platform I have seen so far. Great job!
Marc Klingen
@karmedge thanks for your kind words, let us know if you have any feedback! love what you built with Fixkey: https://www.producthunt.com/prod...