TrueFoundry
AI gateway for routing across 250+ LLMs with fallbacks, rate limiting, guardrails, and RBAC
TrueFoundry is an AI gateway that routes requests to LLMs across providers (OpenAI, Anthropic, Gemini, Mistral, Groq, and others) through a unified API. It adds latency-based routing, weighted load balancing, automatic fallbacks, and per-user or per-team rate limits and token or cost quotas.
The platform includes observability for token usage, latency, and error rates, built-in guardrails (PII filtering, toxicity detection), and governance via role-based access control with per-team API keys. It can run in a VPC, on-prem, or air-gapped, with no request data leaving the customer environment.
Pricing: Free / monthly subscriptions
TrueFoundry Alternatives
Explore 54 products in the Observability & Analytics category. View all TrueFoundry alternatives.
AI Gateway HQ
LLM gateway built around spend limits enforced before a request reaches a provider
2kw.ai
EU-hosted AI integration platform combining a provider gateway, document extraction, evals and cost observability
AISIX
Open-source AI gateway in Rust with one OpenAI-compatible API across 100+ LLM providers
The Context Company
Agent observability that pairs traces with conversation analytics to catch silent failures in production
HAIEC
Scans AI application code, runs adversarial tests against live endpoints, and generates signed compliance evidence
Work on TrueFoundry? Feature it at the top of Observability & Analytics.
Is your product missing?