Home / Frameworks & Stacks / LiteLLM

LiteLLM

Open Source Free Trial

Unified OpenAI-compatible proxy for 100+ LLM providers with cost tracking and load balancing

LiteLLM is a Python SDK and proxy server that provides a single OpenAI-compatible interface to call over 100 LLM APIs, including OpenAI, Anthropic, Azure, Bedrock, Vertex AI, Cohere, and Ollama. It handles cost tracking, budget management, virtual API keys, guardrails, and load balancing across deployments. The proxy can handle 1,500+ requests per second. The core SDK and proxy are open source under MIT, with enterprise features available for teams needing SSO and advanced auth.

Pricing: Free / enterprise

HQ 🇺🇸 United States

Visit website →

Suggest changes

Screenshot of LiteLLM webpage

LiteLLM Alternatives

Explore 21 products in the Frameworks & Stacks category. View all LiteLLM alternatives.

Stagehand

AI-powered browser automation framework with natural language actions, extraction, and observation

Open Source

Mastra

TypeScript-first AI framework for building agents, RAG pipelines, and workflows

Open Source Free Trial

Ollama

Run large language models locally with a single command

Open Source Free Trial From Free (open-source)

Hugging Face

The open-source AI platform with 500K+ models, inference endpoints, and fine-tuning tools

Open Source Free Trial From $0.033/hr (CPU)

Modular

We rebuilt the modern AI software stack, from the ground up, to boost any AI pipeline, on any hardware.

Free Trial From Free

Pydantic AI

Type-safe Python agent framework with Pydantic validation, tool calling, and dependency injection

Open Source

View all Frameworks & Stacks tools ≫

Is your product missing?

Add it here →