@jaredl They are stored in plaintext at this time, but we may add some encryption wrapper around it to make it harder to leak the secret. This applies to both cloud & self hosted.
Report
This looks really useful for streamlining LLM operations! How does LLM Gateway ensure the security of user data, especially when handling keys and requests across multiple providers?
@yongxiang_wang as Luca answered in a similar question: "They are stored in plaintext at this time, but we may add some encryption wrapper around it to make it harder to leak the secret. This applies to both cloud & self hosted."
YouMind
Great to see an open-source solution like LLM Gateway! 🚀 The BYOK feature is intriguing. How does it manage security when users bring their own keys?
LLM Gateway
@jaredl They are stored in plaintext at this time, but we may add some encryption wrapper around it to make it harder to leak the secret. This applies to both cloud & self hosted.
This looks really useful for streamlining LLM operations! How does LLM Gateway ensure the security of user data, especially when handling keys and requests across multiple providers?
LLM Gateway
@yongxiang_wang as Luca answered in a similar question: "They are stored in plaintext at this time, but we may add some encryption wrapper around it to make it harder to leak the secret. This applies to both cloud & self hosted."
Ontwik
Good luck with your project
LLM Gateway
@jefferyhus Thanks mate! can't wait for what's coming!
Woww that is something I was thinking about last months :) best of luck guys
Very nice!
LLM Gateway
@mikestaub thanks! let us know if you have any feedback
Agnes AI
Impressed by the unified API for routing, analytics & cost‑control across multiple LLM providers—streamlined and open‑source! 🚀