LocalAI
Open-source, self-hosted OpenAI-compatible API for running models on your own hardware
LocalAI is an open-source, self-hosted drop-in replacement for the OpenAI API that runs language models, image generation, and audio locally on consumer hardware, with no GPU required. It supports multiple inference backends behind one OpenAI-compatible API.
It deploys via Docker, Podman, Kubernetes, or a single binary, and keeps all data on your own machine. Companion projects (LocalAGI for agents, LocalRecall for semantic search) extend it into a small local AI stack. MIT licensed and free to self-host.
Pricing: Free
LocalAI Alternatives
Explore 31 products in the Frameworks & Stacks category. View all LocalAI alternatives.
Mastra
TypeScript-first AI framework for building agents, RAG pipelines, and workflows
vLLM
High-throughput LLM inference engine with PagedAttention for efficient GPU memory usage
Ollama
Run large language models locally with a single command
Dify
Easily build and operate generative AI applications. Create Assistants API and GPTs based on any LLMs.
Work on LocalAI? Feature it at the top of Frameworks & Stacks.
Is your product missing?