Jan
Open-source desktop app for running LLMs locally with a clean GUI
Jan is an open-source desktop application for running large language models locally on macOS, Windows, and Linux. It provides a ChatGPT-style interface backed by local inference (via llama.cpp) with no internet connection required after model download. Supports Llama, Mistral, Phi, and Gemma families, and can connect to remote APIs (OpenAI, Anthropic, Groq) as an alternative front-end. Built by Menlo Research under Apache-2.0.
Pricing: Free
Jan Alternatives
Explore 31 products in the Frameworks & Stacks category. View all Jan alternatives.
Mastra
TypeScript-first AI framework for building agents, RAG pipelines, and workflows
vLLM
High-throughput LLM inference engine with PagedAttention for efficient GPU memory usage
Ollama
Run large language models locally with a single command
Dify
Easily build and operate generative AI applications. Create Assistants API and GPTs based on any LLMs.
Work on Jan? Feature it at the top of Frameworks & Stacks.
Is your product missing?