Cloudflare AI Gateway
LLM proxy with caching, logging, rate limiting, and cost analytics
Cloudflare AI Gateway is a proxy layer between your application and LLM providers like OpenAI, Anthropic, and Gemini. It provides request logging, cost and token analytics, response caching, rate limiting, retries, and model fallback across 70+ models from 12+ providers through a single endpoint. Integration requires changing one line of code.
Pricing: Free on all plans, Logpush $0.05/M requests on paid
Cloudflare AI Gateway Alternatives
Explore 45 products in the Observability & Analytics category. View all Cloudflare AI Gateway alternatives.
RAGAS
Open-source evaluation and testing framework for LLM and RAG applications
Guardrails AI
Open-source framework for adding input and output validators around LLM calls
NeMo Guardrails
NVIDIA toolkit for adding programmable guardrails to LLM conversational apps
Presidio
Microsoft open-source SDK for detecting and anonymizing PII in text and images
Work on Cloudflare AI Gateway? Feature it at the top of Observability & Analytics.
Is your product missing?