Evidently AI
Open-source ML and LLM evaluation with 100+ built-in metrics and CI/CD integration
Evidently AI is an open-source framework for evaluating and monitoring ML models and LLM applications. It provides 100+ built-in metrics for data quality, model performance, and LLM output evaluation. Supports declarative testing in CI/CD pipelines and offers a dashboard for tracking metrics over time. Works with any ML framework.
Pricing: Free
Choosing an LLM evaluation tool right now?
One click, anonymous. Helps us know our visitors.
Thanks, that helps.
Choosing an LLM evaluation tool right now?
One click, anonymous. Helps us know our visitors.
Thanks, that helps.
Resources
Evidently AI Alternatives
Explore 58 products in the Observability & Analytics category. View all Evidently AI alternatives.
DeepEval
Open-source LLM evaluation framework with 50+ metrics for testing agents, RAG, and chatbots
Future AGI
Open-source platform for testing, monitoring, and improving AI agents with tracing, evals, guardrails, and gateway
LangWatch
LLM observability platform with quality monitoring, guardrails, and evaluation workflows
Cekura
Testing and monitoring platform for AI voice and chat agents
RAGAS
Open-source evaluation and testing framework for LLM and RAG applications
Work on Evidently AI? Feature it at the top of Observability & Analytics.
Is your product missing?