llmkit
One LLM client API for 20+ providers, in Go, TypeScript, Python and Rust
llmkit is a multi-provider LLM client SDK that exposes one consistent API across Anthropic, OpenAI, Google, Bedrock, and 20+ other providers, including local models via Ollama and vLLM. The same features and surface are available in Go, TypeScript, Python, and Rust.
It covers text generation and streaming, tool calling, batch prompting, prompt caching, reasoning effort control, file uploads, and model catalog introspection. Middleware hooks let you observe or veto requests. Developers use it to switch providers without rewriting application code.
Pricing: Free
llmkit Alternatives
Explore 39 products in the Frameworks & Stacks category. View all llmkit alternatives.
LangChain
LangChain gives developers a framework to construct LLM‑powered apps easily.
Langroid
Multi-agent LLM framework using message-based task delegation inspired by the Actor model
TanStack AI
Framework-agnostic TypeScript library for AI chat, streaming, tools, and structured outputs
CC Switch
Open-source desktop manager and local router for AI coding tools
LocalAI
Open-source, self-hosted OpenAI-compatible API for running models on your own hardware
Atomic Chat
Open-source local AI chat app for running open-weight models on desktop and mobile
Work on llmkit? Feature it at the top of Frameworks & Stacks.
Is your product missing?