liteLLM

One library to standardize all LLM APIs

5.0•17 reviews•

137 followers

One library to standardize all LLM APIs

5.0•17 reviews•

137 followers

Visit website

Unified API

•

AI Infrastructure Tools

Simplify using OpenAI, Azure, Cohere, Anthropic, Replicate, Google LLM APIs. TLDR Call all LLM APIs using the chatGPT format - completion(model, messages) Consistent outputs and exceptions for all LLM APIs Logging and Error Tracking for all models

Free

Launch tags:API•Open Source•Developer Tools

Launch Team

MasterClass On Call Desktop beta — Instant feedback on how you communicate & lead in meetings.

Instant feedback on how you communicate & lead in meetings.

Promoted

liteLLM

Maker

📌

Hi Producthunt, @krrish_dholakia and I are super excited to be launching 🚅 liteLLM An Open Source Python library to standardize LLM Inputs/Outputs for 50+ models (OpenAI, Anthropic, Cohere etc) :https://github.com/BerriAI/litellm 🚨Why did we build liteLLM We needed simplicity Our code started to get extremely complicated managing & translating calls between Azure, OpenAI, Cohere, Anthropic, Replicate LLM APIs. 🚀How does it work liteLLM is a Python package that enables calling 50+ LLM API models using a consistent input/output interface - in the chatGPT format here’s an example of how liteLLM works response = completion(model="gpt-3.5-turbo", messages=messages) response = completion("claude-2", messages) response = completion("command-nightly", messages) 📞 Interested in using liteLLM? You can try out liteLLM today for free: https://github.com/BerriAI/litellm/ If you're interested in liteLLM you can meet with me https://calendly.com/d/4mp-gd3-k... or reach me on Twitter: https://twitter.com/ishaan_jaff

Report

2yr ago

Product Hunt Launch Checklist

@krrish_dholakia @ishaan_jaffer Amazing work guys! Congratulations on the launch.

Report

2yr ago

Congrats on the launch! Litellm is really useful for reliably and easily calling LLM APIs.

Report

2yr ago

liteLLM

Maker

@kaushik_s Thank you !

Report

2yr ago

liteLLM

Maker

@krrish_dholakia @falak_sher Thank you !

Report

2yr ago

Congrats on your launch.

Report

2yr ago

liteLLM

Maker

@daniel_oreson Thank you !

Report

2yr ago

LFG

Report

2yr ago

liteLLM

Maker

@yi_ding Thanks for the support❤️

Report

2yr ago

CloudFunnels AI

The product looks good, will check it out

Report

2yr ago

liteLLM

Maker

@cyriljeet Thank you !

Report

2yr ago

5.0

Based on 17 reviews

Review liteLLM?

liteLLM earns strong praise for simplifying multi-provider setups and keeping code consistent while swapping models. Makers of

Me.bot

Instance

, and

Athina AI

highlight its role as a versatile API hub and LLM gateway, noting easy switching and support for custom models. Other makers commend unified interfaces and routing. Users echo that it works well as an OpenAI-compatible proxy, enabling caching, load balancing across providers (including local via Ollama), and smooth integration with observability tools like Langfuse for monitoring and performance analysis.

+14

Summarized with AI

Pros

Cons

Reviews

All Reviews

Most Informative

liteLLM

One library to standardize all LLM APIs

One library to standardize all LLM APIs

What's great

What's great