litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrail…

55k stars1.5k contributorsupdated 2h agoBerriAI/litellm

GitHub Try it

About

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Topics: ai-gateway, anthropic, azure-openai, bedrock, gateway, langchain, litellm, llm, llm-gateway, llmops, mcp-gateway, openai, openai-proxy, rust, rust-ai, vertex-ai

Tags

ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenaiopenai-proxyrustrust-aivertex-ai

GitHub signals

Indexed

stars

55k

forks

10.2k

contributors

1.5k

last commit

2h ago

Verify on GitHub

Details

Category: AI Tools
Type: AI tool
Pricing: Open source
Visit: docs.litellm.ai

Stack

Pythonai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenaiopenai-proxyrustrust-aivertex-ai

Engagement

claps

views

FindIt Score

Low confidence

A 0–100 score from what actually matters: the code, the community, the buzz, and the site itself. Nobody can pay to raise it.

Code: 100
Freshness(modifier): 100

If a bucket has no data, we leave it out rather than guess. Confidence goes up as more independent sources agree.

Community

Your votes feed straight into the FindIt Score. We weight them by account age so new accounts can’t game it.

Trust & provenance

Ownership: Nobody has proved they own this listing.
Provenance: Indexed from the public repo BerriAI/litellm.
Signals: Not enough history yet — we've only just started watching this one.
Safety: Repo is public and reachable, checked 2h ago.

These are automated checks, not a security audit or a promise the tool is any good. Verified ownership means someone proved they control the domain or repo — nothing more. Do your own homework before you rely on it, and especially before you send anyone money.

Open the repo