≫ Home / Frameworks & Stacks / LiteLLM / Alternatives

LiteLLM Alternatives

Unified OpenAI-compatible proxy for 100+ LLM providers with cost tracking and load balancing

Explore 16 alternatives to LiteLLM across 1 category. Each tool listed below shares at least one category with LiteLLM.

🏗️ Frameworks & Stacks

Dify

Easily build and operate generative AI applications. Create Assistants API and GPTs based on any LLMs.

Open Source Free Trial

DSPy

Framework for programming, not prompting, language models with automatic prompt optimization

Open Source

Floom

The AI Gateway - Elevate apps with AI Open source. By devs, for devs.

Open Source

Haystack

The Production-Ready Open Source AI Framework.

Open Source

Instructor

Structured data extraction from LLMs using Pydantic models with automatic validation and retries

Open Source

LangChain

LangChain gives developers a framework to construct LLM‑powered apps easily.

Open Source Free Trial

LangGraph

Low-level framework for building stateful, long-running AI agents with graph-based orchestration

Open Source Free Trial

Langroid

Multi-agent LLM framework using message-based task delegation inspired by the Actor model

Open Source

LlamaIndex

LlamaIndex is a simple, flexible data framework for connecting custom data sources to large language models.

Open Source

LLM Browser

Enable your AI agents to access any website without worrying about captchas, proxies and anti-bot challenges

Open Source Free Trial

Modular

We rebuilt the modern AI software stack, from the ground up, to boost any AI pipeline, on any hardware.

Free Trial

phidata

Build an AI App in minutes using pre-built templates.

Open Source Free Trial

Pydantic AI

Type-safe Python agent framework with Pydantic validation, tool calling, and dependency injection

Open Source

Semantic Kernel

Microsoft's SDK for building and orchestrating AI agents in .NET, Python, and Java

Open Source

Spring AI

Spring framework for building AI-powered Java applications with portable model and vector store abstractions

Open Source

Vercel AI SDK

Open-source TypeScript toolkit for building AI applications with streaming, tool calling, and agents

Open Source

View LiteLLM

Is your product missing? 👀 Add it here →