PromptFoo

Open-source CLI for testing, evaluating, and red-teaming LLM applications

Open Source Free Trial

PromptFoo is an open-source tool for testing and evaluating LLM outputs. It lets you compare prompts and models side-by-side across 50+ providers, define test cases in declarative YAML with assertions and scoring, and red-team LLM apps against 50+ vulnerability types including jailbreaks and prompt injection. Results are viewable in a terminal matrix or built-in web UI. Integrates into CI/CD pipelines to gate deployments on eval results. Used by 200,000+ developers and 80+ Fortune 500 companies.

Pricing: Free / enterprise

Visit website →

Pricing

GitHub

Posts

Suggest changes