LiteLLM

Unified OpenAI-compatible proxy for 100+ LLM providers with cost tracking and load balancing

Open Source Free Trial

LiteLLM is a Python SDK and proxy server that provides a single OpenAI-compatible interface to call over 100 LLM APIs, including OpenAI, Anthropic, Azure, Bedrock, Vertex AI, Cohere, and Ollama. It handles cost tracking, budget management, virtual API keys, guardrails, and load balancing across deployments. The proxy can handle 1,500+ requests per second. The core SDK and proxy are open source under MIT, with enterprise features available for teams needing SSO and advanced auth.

Pricing: Free / enterprise

Visit website →

Pricing

GitHub

Posts

Suggest changes

LiteLLM Alternatives

Explore 17 products in the Frameworks & Stacks category. View all LiteLLM alternatives.

Langroid

Multi-agent LLM framework using message-based task delegation inspired by the Actor model

Spring AI

Spring framework for building AI-powered Java applications with portable model and vector store abstractions

Semantic Kernel

Microsoft's SDK for building and orchestrating AI agents in .NET, Python, and Java

Pydantic AI

Type-safe Python agent framework with Pydantic validation, tool calling, and dependency injection

Vercel AI SDK

Open-source TypeScript toolkit for building AI applications with streaming, tool calling, and agents

LangGraph

Low-level framework for building stateful, long-running AI agents with graph-based orchestration

View all Frameworks & Stacks tools ≫

Is your product missing? 👀 Add it here →