Daily.co
Real-time voice, video, and AI for developers
Start new thread
Kwindla Kramer

Daily Bots - Build voice-to-voice AI agents with any LLM with Open Source

by
Daily.co
•
Build hosted AI agents on Daily Bots, the Open Source cloud for ultra low latency voice and video. Use commercial and open models. Incorporate tool use, telephony, vision, etc. If your needs evolve beyond Daily Bots, run your code anywhere that supports RTVI.

Add a comment

Replies

Best
Mert Gerdan
The daily bots are crazy fast! Congrats for the entire Daily team on this launch, you are building something that should honestly be standardized when building multimodal agents.
Kwindla Kramer
Maker
@mert_gerdan Standardization is definitely a big part of the motivation for Daily Bots overall. - We want developers to be able to write code that they can use with a wide variety of real-time inference services. (Not just Daily.) - We think that standardization helps an ecosystem grow faster. - The more inference providers have really good real-time offerings, the more people will understand the nuances of low-level networking, how to optimize for low latency, etc. And that's the area we've always focused on building great tech for!
Prasenjit Mukherjee
So awesome! We've now built a whole demo on and that was a great experience. Looking forward to sussing out DailyBots before launch. One problem with pipecat was the scalability of the backend was a little wonky (literally just cloning python subprocesses). This feels like it's taken care of more elegantly here? Can someone confirm?
Kwindla Kramer
Maker
@pj_mukh Implementing scalability elegantly was one of our main goals for Daily Bots. We have a lot of experience running infrastructure, so I'm confident we can scale efficiently -- both so individual customers see fast bot joins and so we can charge low prices that enable a broad range of use cases. Having said that, forking Python processes is actually part of how we achieve fast join times. Avoiding the Python interpreter startup time is helpful! But we also have capacity routing via queues, autoscaling that leverages the cluster scaling we do for WebRTC at Daily, etc.
Robert Thomas
Great to see Daily Bots launching on PH! The focus on both open source and commercial models is impressive, and it’s exciting to witness the evolution of voice and video AI. The integration of multi-modal workflows and tools like Pipecat makes it super flexible for developers. Can’t wait to explore the demo and see how it can enhance different applications. Big shoutout to @kwindla for leading this initiative! Excited for what’s next in this space.
nina k
Maker
@robertthomas2 +1, it'll be really fun to see what makers do with this! Thank you, and it's nice to be back on PH :)
Patricia Harris
Looks interesting, @kwindla! The ability to run both commercial and open models on Daily Bots really opens up possibilities for various applications. I'm curious about the performance. How does the latency compare with other similar platforms, especially for real-time communication? Also, can you share any specific use cases or success stories from your early adopters? It would be great to see how teams leverage the Open Source SDKs you've developed. Lastly, how easy is it for developers to transition to a different platform if they choose to? The concept of flexibility sounds appealing, but I'd love to know more about the actual implementation. Thanks for sharing this on PH!
Kwindla Kramer
Maker
@patriciaharris Daily Bots can deliver voice-to-voice latency as low as 500ms, depending on the models you choose. This is substantially faster than most other voice apps. Typical latencies are 1.2 seconds or more. There are trade-offs: using larger and more capable LLMs tends to be slower than using smaller, faster models. However, we've partnered with Together to make it easy to use the Llama 3.1 models with Daily Bots and together has very fast "time to first token" metrics even with the largest (405B) Llama 3.1 model. Daily Bots is brand new. But we've worked closely with many partners who have built on Daily and Pipecat to create the pieces that Daily Bot brings together into a single platform. You may have seen Tavus' launch last week. Tavus was #1 product of the day last Thursday. If you're interested in the open standards that Daily Bots is built on, check out Pipecat and RTVI: - https://github.com/pipecat-ai/pi... - https://github.com/rtvi-ai
Chad Bailey
Maker
This is John, a totally normal human person. https://x.com/chadbailey59/statu...
Alexander Scott Williams
This is an exciting launch, @kwindla! The potential for Daily Bots to empower developers with both open-source and commercial models is fantastic. The versatility offered by Pipecat and RTVI really sets this apart—can't wait to see how it transforms voice and video applications. 🚀 The integration of real-time workflows is definitely a game-changer for creating sophisticated AI agents. Looking forward to experimenting with the demo and exploring the possibilities! What are some unique use cases you've seen so far?
Christopher David Anderson
Loving the potential of Daily Bots! The flexibility to run on various platforms while leveraging Open Source tools is a game changer for developers. Excited to see the innovations from @kwindla! Upvoted!
Akhil
Maker
appreciate your support @christopherdavidanderson! We are looking forward to seeing how developers leverages open source to build new conversational experiences
Den Taylor
The global real-time infrastructure and support for both commercial and open models make Daily an excellent choice for developing cutting-edge AI solutions.
nina k
Maker
@den_taylor 💪🏼 🍻 Thank you!
Yujian Tang
looks awesome, looking forward to using these!
nina k
Maker
@yujian_tavus Thank you! Love what the Tavus team is building.
Ivelin Kozarev
love Daily - you guys are doing so much for the voice AI community!
Kwindla Kramer
Maker
@ivelin_kozarev Thanks! Your profile says "Launching soon!" Can't wait to see what you launch.
First
Previous
123
Next
Last