llmkit
One LLM client API for 20+ providers, in Go, TypeScript, Python and Rust
llmkit is a multi-provider LLM client SDK that exposes one consistent API across Anthropic, OpenAI, Google, Bedrock, and 20+ other providers, including local models via Ollama and vLLM. The same features and surface are available in Go, TypeScript, Python, and Rust.
It covers text generation and streaming, tool calling, batch prompting, prompt caching, reasoning effort control, file uploads, and model catalog introspection. Middleware hooks let you observe or veto requests. Developers use it to switch providers without rewriting application code.
Pricing: Free
llmkit Alternatives
Explore 30 products in the Frameworks & Stacks category. View all llmkit alternatives.
GPT4All
Desktop app and Python SDK for running open-source LLMs locally on any device
Work on llmkit? Feature it at the top of Frameworks & Stacks.
Is your product missing?