Cloudflare AI Gateway Alternatives
LLM proxy with caching, logging, rate limiting, and cost analytics
Cloudflare AI Gateway is a proxy layer between your application and LLM providers like OpenAI, Anthropic, and Gemini.
Explore 34 alternatives to Cloudflare AI Gateway across 1 category. Updated September 2026.
Top Cloudflare AI Gateway alternatives at a glance
- Portkey. AI gateway for routing to 1,600+ LLMs with observability, guardrails, and prompt management
- AI Gateway HQ. LLM gateway built around spend limits enforced before a request reaches a provider
- AISIX. Open-source AI gateway in Rust with one OpenAI-compatible API across 100+ LLM providers
- 2kw.ai. EU-hosted AI integration platform combining a provider gateway, document extraction, evals and cost observability
- TrueFoundry. AI gateway for routing across 250+ LLMs with fallbacks, rate limiting, guardrails, and RBAC
Compare Cloudflare AI Gateway with its alternatives
| Product | Pricing Model | Free Tier | Open Source | Hosting | HQ |
|---|---|---|---|---|---|
| Cloudflare AI Gateway | Freemium | — | — | Cloud | 🇺🇸 United States |
| Portkey | Freemium | ✓ | ✓ | Cloud + Self-hosted | 🇺🇸 United States |
| AI Gateway HQ | Pay-per-use | ✓ | — | Cloud | 🇺🇸 United States |
| AISIX | Freemium | ✓ | ✓ APACHE-2.0 | Cloud + Self-hosted | — |
| 2kw.ai | Subscription | ✓ | — | Cloud | 🇩🇪 Germany |
| TrueFoundry | Freemium | ✓ | — | Cloud + Self-hosted | 🇺🇸 United States |
| Vercel AI Gateway | Freemium | ✓ | — | Cloud | 🇺🇸 United States |
| Langfuse | Freemium | ✓ | ✓ MIT | Cloud + Self-hosted | 🇩🇪 Germany |
| Comet Opik | Freemium | ✓ | ✓ APACHE2 | Cloud + Self-hosted | 🇺🇸 United States |
| Weights & Biases | Freemium | ✓ | — | Cloud + Self-hosted | 🇺🇸 United States |
| Arize AI | Freemium | ✓ | ✓ ELASTIC-2.0 | Cloud + Self-hosted | 🇺🇸 United States |
| Traceloop | Freemium | ✓ | ✓ | Cloud + Self-hosted | 🇺🇸 United States |
| Helicone | Freemium | ✓ | ✓ APACHE2 | Cloud + Self-hosted | 🇺🇸 United States |
| Agenta | Freemium | ✓ | ✓ MIT | Cloud + Self-hosted | 🇩🇪 Germany |
| LangWatch | Freemium | ✓ | ✓ MIT | Cloud + Self-hosted | 🇳🇱 Netherlands |
| Future AGI | Freemium | ✓ | ✓ APACHE-2.0 | Cloud + Self-hosted | 🇺🇸 United States |
📊 Observability & Analytics
Comet Opik
Comet provides an end-to-end model evaluation platform for AI developers.
Agenta
Open-source prompt management, evaluation, and observability for LLM apps
Laminar
Open-source agent observability with traces, failure detection and evals
Dunetrace
Runtime reliability and failure detection for AI agents
Braintrust
Stop building AI in the dark.
Browse all 54 Observability & Analytics products
Work on a Observability & Analytics product? Feature it at the top of this page.
Is your product missing?