Portkey

Portkey is an AI infrastructure platform with an open-source AI gateway at its core. It routes requests to 1,600+ LLMs across 200+ providers through a unified API, with automatic retries, fallbacks, load balancing, and caching. The platform adds real-time observability with cost tracking and latency monitoring, prompt versioning and management, 50+ built-in guardrails for input/output validation, and governance features like RBAC and budget controls. Free tier includes 10,000 logs per month.