Portkey Alternatives
AI gateway for routing to 1,600+ LLMs with observability, guardrails, and prompt management
Portkey is an AI infrastructure platform with an open-source AI gateway at its core.
Explore 58 alternatives to Portkey across 2 categories. Each tool listed below shares at least one category with Portkey.
Top Portkey alternatives at a glance
- TrueFoundry. AI gateway for routing across 250+ LLMs with fallbacks, rate limiting, guardrails, and RBAC
- Vercel AI Gateway. Unified API for hundreds of AI models, with built-in rate limiting and key management
- Cloudflare AI Gateway. LLM proxy with caching, logging, rate limiting, and cost analytics
- Langfuse. Traces, evals, prompt management and metrics to debug and improve your LLM application.
- Comet Opik. Comet provides an end-to-end model evaluation platform for AI developers.
📊 Observability & Analytics
Comet Opik
Comet provides an end-to-end model evaluation platform for AI developers.
Agenta
Open-source prompt management, evaluation, and observability for LLM apps
Dunetrace
Runtime reliability and failure detection for AI agents
Braintrust
Stop building AI in the dark.
RAGAS
Open-source evaluation and testing framework for LLM and RAG applications
Presidio
Microsoft open-source SDK for detecting and anonymizing PII in text and images
Guardrails AI
Open-source framework for adding input and output validators around LLM calls
NeMo Guardrails
NVIDIA toolkit for adding programmable guardrails to LLM conversational apps
✍️ Prompt engineering
PromptFoo
Open-source CLI for testing, evaluating, and red-teaming LLM applications
Prompt Mixer
Open source app for prompt testing
.png)
Fixie
The fastest way to build conversational AI agents
Superagent
Prototype and deploy agents powered by large language models.
Frequently asked questions
What are the best alternatives to Portkey?
Based on category overlap and popularity, the top alternatives to Portkey include: TrueFoundry (AI gateway for routing across 250+ LLMs with fallbacks, rate limiting, guardr...); Vercel AI Gateway (Unified API for hundreds of AI models, with built-in rate limiting and key ma...); Cloudflare AI Gateway (LLM proxy with caching, logging, rate limiting, and cost analytics); Langfuse (Traces, evals, prompt management and metrics to debug and improve your LLM ap...); Comet Opik (Comet provides an end-to-end model evaluation platform for AI developers.). See all 58 alternatives compared on this page.
Is there a free alternative to Portkey?
Yes. 52 alternatives to Portkey offer a free tier or free trial: TrueFoundry, Vercel AI Gateway, Langfuse, Comet Opik, Weights & Biases, Arize AI, and more. Use the comparison above to find the best fit for your use case.
Are there open-source alternatives to Portkey?
Yes. 26 of the 58 alternatives to Portkey listed here are open source: Langfuse, Comet Opik, Arize AI, Traceloop, Helicone, Agenta, and more. Open-source tools can be self-hosted for full control over data and infrastructure.
What is Portkey?
Portkey is an AI infrastructure platform with an open-source AI gateway at its core. It routes requests to 1,600+ LLMs across 200+ providers through a unified API, with automatic retries, fallbacks, load balancing, and caching. The platform adds real-time observability with cost tracking and late... See 58 alternatives to Portkey across 2 categories.
Work on a Observability & Analytics product? Feature it at the top of this page.
Is your product missing?