llmkit
One LLM client API for 20+ providers, in Go, TypeScript, Python and Rust
llmkit is a multi-provider LLM client SDK that exposes one consistent API across Anthropic, OpenAI, Google, Bedrock, and 20+ other providers, including local models via Ollama and vLLM. The same features and surface are available in Go, TypeScript, Python, and Rust.
It covers text generation and streaming, tool calling, batch prompting, prompt caching, reasoning effort control, file uploads, and model catalog introspection. Middleware hooks let you observe or veto requests. Developers use it to switch providers without rewriting application code.
Pricing: Free
llmkit Alternatives
Explore 31 products in the Frameworks & Stacks category. View all llmkit alternatives.
Mastra
TypeScript-first AI framework for building agents, RAG pipelines, and workflows
vLLM
High-throughput LLM inference engine with PagedAttention for efficient GPU memory usage
Ollama
Run large language models locally with a single command
Dify
Easily build and operate generative AI applications. Create Assistants API and GPTs based on any LLMs.
Work on llmkit? Feature it at the top of Frameworks & Stacks.
Is your product missing?