litellm is by BerriAI — not by us.
We indexed this project so people can find it. We are not selling it, we host no copy of the code, and we are not affiliated with or endorsed by its authors — get it from them.
The core of this project is MIT-licensed (detected from the license text; GitHub could not classify it automatically) and free to use. A separate portion is commercially licensed by the publisher — from the upstream license: "Portions of this software are licensed as follows". Read the upstream LICENSE before relying on any enterprise feature.
We flag this because a repository page rarely makes the boundary obvious — you often find out which features are paid only after building on them.
Indexed Aug 1, 2026 · 55,207 stars at index time. Maintainers: claiming verifies your identity and unlocks a higher assurance tier. Removal requests are honored.
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tra
by Open Source Community · New publisher
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
**BerriAI/litellm** is an open-source project by BerriAI: The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]. Indexed here so it can be found — not resold.
It is free. Get it from the upstream repository: https://github.com/BerriAI/litellm
From the project's own README (excerpt, reproduced for discovery under its null license):
🚅 LiteLLM LiteLLM AI Gateway Open Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready. Call any LLM in OpenAI format. LiteLLM Proxy Server (AI Gateway) Hosted Proxy Enterprise Tier Website
---
What is LiteLLM
LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers — OpenAI, Anthropic, Gemini, Bedrock, Azure, and more — using the OpenAI format.
Use it as a Python SDK for direct library integration, or deploy the AI Gateway (Proxy Server) as a centralized service for your team or organization.
Jump to LiteLLM Proxy (LLM Gateway) Docs Jump to Supported LLM Providers
---
Why LiteLLM
Managing LLM calls across providers gets complicated fast — different SDKs, auth patterns, request formats, and error types for every model. LiteLLM removes that friction: • Unified API — one interface for 100+ LLMs, no provider-specific SDK juggling • Drop-in OpenAI compatibility — swap providers without rewriting your code • Production-ready gateway — virtual keys, spend tracking, guardrails, load balancing, and an admin dashboard out of the box • 8ms P95 latency at 1k RPS (benchmarks)
OSS Adopters
Netflix
---
Features
LLMs - Call 100+ LLMs (Python SDK + AI Gateway)
All Supported Endpoints - /chat/completions, /responses, /embeddings, /images, /audio, /batches, /rerank, /a2a, /messages and more.
Python SDK
AI Gateway (Proxy Server)
Getting Started - E2E Tutorial - Setup virtual keys, make your first request
Docs: LLM Providers
Agents - Invoke A2A Agents (Python SDK + AI Gateway)
Supported Providers - LangGraph, Vertex AI Agent Engine, Azure AI Foundry, Bedrock AgentCore, Pydantic AI
Python…
Preview
See what it does before you commit. Previews show behavior, never source code.
Capabilities
Requirements & stack
Depends on
- → PostgreSQL database
- → Authentication
Credentials needed
None declared
Stack
Companions & conflicts
- None declared
Community
No endorsements yetEndorsements come from verified purchasers and vetted trusted reviewers, weighted by standing. They grade quality and trustworthiness — security is verified separately and community votes can never override the security gate.
Sign in with a verified purchase to endorse.
Trust Passport
Full passport →0/0 automated components pass. An automated score is never a security guarantee.
This listing is unclaimed, so publisher identity cannot be verified and it stays below the “verified” tier by design — that is a statement about the listing, not about the project’s quality. Our automated scans still ran; a maintainer who claims it unlocks identity verification.
- publisher identity Publisher status verified; 0 verification(s) on file
- malicious pattern scan No known malicious-behavior patterns detected in reviewed content
- capability contract All 0 observed capability reference(s) match the declared manifest
- agent safety scan No injection patterns in agent-readable content
- provenance No release signature or provenance attestation
- behavioral sandbox Not performed in this environment — requires the production isolated runner (docs/sandbox-requirements.md). No untrusted code is ever executed on the application host.
Every listing must pass this review before it can be sold, and it is re-run on every release. Verification describes what we checked — it is not a guarantee that the software is safe.
Versions
Full history →| Version | Channel | Released | Notes |
|---|---|---|---|
| 0.0.0 | stable | Aug 1, 2026 | Indexed listing — see the upstream repository for real release history. |
Similar products
Nearest matches by capability and description — not curated alternatives.