Portkey
AI gateway for routing to 1,600+ LLMs with observability, guardrails, and prompt management
Portkey is an AI infrastructure platform with an open-source AI gateway at its core. It routes requests to 1,600+ LLMs across 200+ providers through a unified API, with automatic retries, fallbacks, load balancing, and caching. The platform adds real-time observability with cost tracking and latency monitoring, prompt versioning and management, 50+ built-in guardrails for input/output validation, and governance features like RBAC and budget controls. Free tier includes 10,000 logs per month.
Pricing: Free / monthly subscriptions
Portkey Alternatives
Explore 45 products in the Observability & Analytics category. View all Portkey alternatives.
RAGAS
Open-source evaluation and testing framework for LLM and RAG applications
Guardrails AI
Open-source framework for adding input and output validators around LLM calls
NeMo Guardrails
NVIDIA toolkit for adding programmable guardrails to LLM conversational apps
Presidio
Microsoft open-source SDK for detecting and anonymizing PII in text and images
Also listed in
Work on Portkey? Feature it at the top of Observability & Analytics.
Is your product missing?