Evidently AI
Open-source ML and LLM evaluation with 100+ built-in metrics and CI/CD integration
Evidently AI is an open-source framework for evaluating and monitoring ML models and LLM applications. It provides 100+ built-in metrics for data quality, model performance, and LLM output evaluation. Supports declarative testing in CI/CD pipelines and offers a dashboard for tracking metrics over time. Works with any ML framework.
Pricing: Free
Resources
Evidently AI Alternatives
Explore 49 products in the Observability & Analytics category. View all Evidently AI alternatives.
Weckr
Tracks LLM cost and margin per end customer, with spending caps that fire before the call
EidoStack
Browser workspace for comparing LLM responses side by side using your own API keys
AI Gateway HQ
LLM gateway built around spend limits enforced before a request reaches a provider
Work on Evidently AI? Feature it at the top of Observability & Analytics.
Is your product missing?