TextGen
Formerly text-generation-webui: open-source desktop app and web UI for local LLMs with an OpenAI-compatible API
TextGen (formerly text-generation-webui, often called oobabooga) is an open-source desktop app and browser UI for running LLMs locally. Portable builds for Linux, Windows and macOS ship llama.cpp with CUDA, Vulkan, ROCm or CPU-only options and load GGUF models.
The full install adds ik_llama.cpp, Transformers, ExLlamaV3 and TensorRT-LLM backends, switchable without a restart, plus LoRA training.
With the API enabled it serves OpenAI- and Anthropic-compatible endpoints on port 5000. AGPL-3.0 licensed.
Pricing: Free
Choosing a local LLM runtime right now?
One click, anonymous. Helps us know our visitors.
Thanks, that helps.
Choosing a local LLM runtime right now?
One click, anonymous. Helps us know our visitors.
Thanks, that helps.
TextGen Alternatives
Explore 49 products in the Frameworks & Stacks category. View all TextGen alternatives.
GPT4All
Desktop app and Python SDK for running open-source LLMs locally on any device
LocalAI
Open-source, self-hosted OpenAI-compatible API for running models on your own hardware
Jan
Open-source desktop app for running LLMs locally with a clean GUI
Dify
Easily build and operate generative AI applications. Create Assistants API and GPTs based on any LLMs.
LangChain
LangChain gives developers a framework to construct LLM‑powered apps easily.
Work on TextGen? Feature it at the top of Frameworks & Stacks.
Is your product missing?