TextGen
Formerly text-generation-webui: open-source desktop app and web UI for local LLMs with an OpenAI-compatible API
TextGen (formerly text-generation-webui, often called oobabooga) is an open-source desktop app and browser UI for running LLMs locally. Portable builds for Linux, Windows and macOS ship llama.cpp with CUDA, Vulkan, ROCm or CPU-only options and load GGUF models.
The full install adds ik_llama.cpp, Transformers, ExLlamaV3 and TensorRT-LLM backends, switchable without a restart, plus LoRA training.
With the API enabled it serves OpenAI- and Anthropic-compatible endpoints on port 5000. AGPL-3.0 licensed.
Pricing: Free
Choosing a local LLM runtime right now?
One click, anonymous. Helps us know our visitors.
Thanks, that helps.
Choosing a local LLM runtime right now?
One click, anonymous. Helps us know our visitors.
Thanks, that helps.
TextGen Alternatives
Explore 49 products in the Frameworks & Stacks category. View all TextGen alternatives.
Jan
Open-source desktop app for running LLMs locally with a clean GUI
LocalAI
Open-source, self-hosted OpenAI-compatible API for running models on your own hardware
Magnitude
Open-source desktop inference engine that tunes its kernels to your hardware and connects local models to your agent.
Dify
Easily build and operate generative AI applications. Create Assistants API and GPTs based on any LLMs.
LangChain
LangChain gives developers a framework to construct LLM‑powered apps easily.
Work on TextGen? Feature it at the top of Frameworks & Stacks.
Is your product missing?