LocalAI

Open Source

Open-source, self-hosted OpenAI-compatible API for running models on your own hardware

LocalAI is an open-source, self-hosted drop-in replacement for the OpenAI API that runs language models, image generation, and audio locally on consumer hardware, with no GPU required. It supports multiple inference backends behind one OpenAI-compatible API.

It deploys via Docker, Podman, Kubernetes, or a single binary, and keeps all data on your own machine. Companion projects (LocalAGI for agents, LocalRecall for semantic search) extend it into a small local AI stack. MIT licensed and free to self-host.

Pricing: Free

Screenshot of LocalAI webpage

Work on LocalAI? Feature it at the top of Frameworks & Stacks.

Is your product missing?

Add it here →