Portkey
AI gateway for routing to 1,600+ LLMs with observability, guardrails, and prompt management
Portkey is an AI infrastructure platform with an open-source AI gateway at its core. It routes requests to 1,600+ LLMs across 200+ providers through a unified API, with automatic retries, fallbacks, load balancing, and caching. The platform adds real-time observability with cost tracking and latency monitoring, prompt versioning and management, 50+ built-in guardrails for input/output validation, and governance features like RBAC and budget controls. Free tier includes 10,000 logs per month.
Pricing: Free / monthly subscriptions
Choosing an LLM gateway right now?
One click, anonymous. Helps us know our visitors.
Thanks, that helps.
Choosing an LLM gateway right now?
One click, anonymous. Helps us know our visitors.
Thanks, that helps.
Portkey Alternatives
Explore 58 products in the Observability & Analytics category. View all Portkey alternatives.
2kw.ai
EU-hosted AI integration platform combining a provider gateway, document extraction, evals and cost observability
AISIX
Open-source AI gateway in Rust with one OpenAI-compatible API across 100+ LLM providers
AI Gateway HQ
LLM gateway built around spend limits enforced before a request reaches a provider
DeepEval
Open-source LLM evaluation framework with 50+ metrics for testing agents, RAG, and chatbots
Traceloop
Open-source LLM observability built on OpenTelemetry, with automatic instrumentation for major providers and frameworks
Galileo
AI evaluation and observability platform with hallucination detection and real-time guardrails
Also listed in
Work on Portkey? Feature it at the top of Observability & Analytics.
Is your product missing?