Langfuse is the open source LLM Engineering Platform.
It provides observability, tracing, evaluations, prompt management, playground and metrics to debug and improve LLM apps.
Langfuse is open. It works with any model, framework and you can export all data.
The prompt management and tracing features are particularly intriguing. What measures have you taken to ensure data security and privacy, especially since this is a platform that interacts with potentially sensitive information?
@r_martirosyan data security and privacy is extremely important to us as many traces in Langfuse contain PII or valuable IP of our customers.
Short summary:
- US / data residency options
- Professional penetration test to ensure our interfaces are safe
- Following security best practices
- GDPR, ISO 27001, and soon SOC 2 Type 2 compliance (pending)
Find out more information here https://langfuse.com/security and feel free to reach out to me or security@langfuse.com if you have any questions.
Really happy with the product. It's very intuitive
- Traces work very well for Agentic Workflows
- Scores is another great feature to help us create datasets for finetuning
- Plus, looking forward to your new eval feature!
@aqib_ansari thanks Aqib, appreciate your continuous product feedback a lot! It really helps us build the best product and continuously learn what your team needs to build the best agents 🙏
@dan_meier1 thanks, the decorator is for sure the biggest upgrade to the Langfuse developer experience in Python!
We wrote a more technical blog post on it here: https://langfuse.com/blog/2024-0...
Report
Love the new features! Great job on shipping so fast!
Congrats on the launch! I'm curious about how Langfuse handles scaling, especially with the growing volume of events and users. Can you elaborate on the scaling strategies you've implemented to ensure smooth performance as you scale?
@anastasia_chakileva_ we currently scale out our application, on Google Cloud Run and Vercel. We closely measure capacity and performance and this setup scales really well.
We are currently working on v3.0 of Langfuse which will include some infrastructure changes to make Langfuse even more scalable, support larger traces with videos/images, and faster dashboard performance.
Replies
Langfuse
Langfuse
Langfuse
Langfuse
viral.app
Langfuse
Langfuse
Langfuse
Langfuse
Yapify
Langfuse
Langfuse
Langfuse
Stormy
Langfuse