TrueFoundry
AI gateway for routing across 250+ LLMs with fallbacks, rate limiting, guardrails, and RBAC
TrueFoundry is an AI gateway that routes requests to LLMs across providers (OpenAI, Anthropic, Gemini, Mistral, Groq, and others) through a unified API. It adds latency-based routing, weighted load balancing, automatic fallbacks, and per-user or per-team rate limits and token or cost quotas.
The platform includes observability for token usage, latency, and error rates, built-in guardrails (PII filtering, toxicity detection), and governance via role-based access control with per-team API keys. It can run in a VPC, on-prem, or air-gapped, with no request data leaving the customer environment.
Pricing: Free / monthly subscriptions
TrueFoundry Alternatives
Explore 49 products in the Observability & Analytics category. View all TrueFoundry alternatives.
Weckr
Tracks LLM cost and margin per end customer, with spending caps that fire before the call
EidoStack
Browser workspace for comparing LLM responses side by side using your own API keys
AI Gateway HQ
LLM gateway built around spend limits enforced before a request reaches a provider
Work on TrueFoundry? Feature it at the top of Observability & Analytics.
Is your product missing?