TrueFoundry
AI gateway for routing across 250+ LLMs with fallbacks, rate limiting, guardrails, and RBAC
TrueFoundry is an AI gateway that routes requests to LLMs across providers (OpenAI, Anthropic, Gemini, Mistral, Groq, and others) through a unified API. It adds latency-based routing, weighted load balancing, automatic fallbacks, and per-user or per-team rate limits and token or cost quotas.
The platform includes observability for token usage, latency, and error rates, built-in guardrails (PII filtering, toxicity detection), and governance via role-based access control with per-team API keys. It can run in a VPC, on-prem, or air-gapped, with no request data leaving the customer environment.
Pricing: Free / monthly subscriptions
TrueFoundry Alternatives
Explore 45 products in the Observability & Analytics category. View all TrueFoundry alternatives.
RAGAS
Open-source evaluation and testing framework for LLM and RAG applications
Guardrails AI
Open-source framework for adding input and output validators around LLM calls
NeMo Guardrails
NVIDIA toolkit for adding programmable guardrails to LLM conversational apps
Presidio
Microsoft open-source SDK for detecting and anonymizing PII in text and images
Work on TrueFoundry? Feature it at the top of Observability & Analytics.
Is your product missing?