liteLLM

One library to standardize all LLM APIs

5.0•24 reviews•

206 followers

One library to standardize all LLM APIs

5.0•24 reviews•

206 followers

Visit website

Unified API

•

AI Infrastructure Tools

Simplify using OpenAI, Azure, Cohere, Anthropic, Replicate, Google LLM APIs. TLDR Call all LLM APIs using the chatGPT format - completion(model, messages) Consistent outputs and exceptions for all LLM APIs Logging and Error Tracking for all models

Free

Launch tags:API•Open Source•Developer Tools

Launch Team

Viktor.comAn AI coworker that actually does the work

Promoted

liteLLM

Maker

📌

Hi Producthunt, @krrish_dholakia and I are super excited to be launching 🚅 liteLLM An Open Source Python library to standardize LLM Inputs/Outputs for 50+ models (OpenAI, Anthropic, Cohere etc) :https://github.com/BerriAI/litellm 🚨Why did we build liteLLM We needed simplicity Our code started to get extremely complicated managing & translating calls between Azure, OpenAI, Cohere, Anthropic, Replicate LLM APIs. 🚀How does it work liteLLM is a Python package that enables calling 50+ LLM API models using a consistent input/output interface - in the chatGPT format here’s an example of how liteLLM works response = completion(model="gpt-3.5-turbo", messages=messages) response = completion("claude-2", messages) response = completion("command-nightly", messages) 📞 Interested in using liteLLM? You can try out liteLLM today for free: https://github.com/BerriAI/litellm/ If you're interested in liteLLM you can meet with me https://calendly.com/d/4mp-gd3-k... or reach me on Twitter: https://twitter.com/ishaan_jaff

Report

3yr ago

Product Hunt Launch Checklist

@krrish_dholakia @ishaan_jaffer Amazing work guys! Congratulations on the launch.

Report

3yr ago

Congrats on the launch! Litellm is really useful for reliably and easily calling LLM APIs.

Report

3yr ago

liteLLM

Maker

@kaushik_s Thank you !

Report

3yr ago

liteLLM

Maker

@krrish_dholakia @falak_sher Thank you !

Report

3yr ago

Congrats on your launch.

Report

3yr ago

liteLLM

Maker

@daniel_oreson Thank you !

Report

3yr ago

LFG

Report

3yr ago

liteLLM

Maker

@yi_ding Thanks for the support❤️

Report

3yr ago

CloudFunnels AI

The product looks good, will check it out

Report

3yr ago

liteLLM

Maker

@cyriljeet Thank you !

Report

3yr ago

LLM Gateway

A better alternative: https://www.producthunt.com/products/llm-gateway

Report

4mo ago

5.0

Based on 24 reviews

Review liteLLM?

Reviewers mostly describe liteLLM as a practical abstraction layer for teams using several model providers. The clearest user feedback highlights it as an LLM proxy with caching, load balancing, local model support through Ollama, and an OpenAI-compatible API that works across many apps when the base URL is configurable. Founders from Budibase, SellerClaw, and ARBR echo that it reduces integration work, speeds switching and fallback between providers, and helps avoid vendor lock-in.

+21

Summarized with AI

Pros

Cons

Reviews

All Reviews

Most Informative

liteLLM

One library to standardize all LLM APIs

One library to standardize all LLM APIs

What's great

Alternatives Considered

What's great

Alternatives Considered