Discover AI Infrastructure Tools

Open-source platform for testing, monitoring, and improving AI agents with tracing, evals, guardrails, and gateway

Open-source testing platform for LLM and agentic applications. Test generation, adversarial probing, and regression tracking.

LLM proxy with caching, logging, rate limiting, and cost analytics

Production monitoring for AI agents with automated failure detection and diagnosis

Open-source prompt management, evaluation, and observability for LLM apps

Unified OpenAI-compatible API gateway that routes requests across multiple LLM providers

On-demand NVIDIA Blackwell GPU cloud with per-second billing, SSH, CLI, and an OpenAI-compatible inference API

ASIC-powered inference cloud built for AI agents, OpenAI-compatible API

Managed AI inference endpoints and GPU infrastructure with OpenAI-compatible API

Web-grounded AI answers API with citations, OpenAI-compatible, pay-per-query pricing

AI-powered browser automation framework with natural language actions, extraction, and observation

Open-source agent development kit from Google for building multi-agent systems

TypeScript-first AI framework for building agents, RAG pipelines, and workflows

Multi-agent LLM framework using message-based task delegation inspired by the Actor model

Spring framework for building AI-powered Java applications with portable model and vector store abstractions

Fine-tune and deploy LLMs on your own infrastructure with full data sovereignty

European cloud provider with AI inference, training, and deployment services

Open-source fine-tuning framework for 100+ LLMs with a web UI

PyTorch-native library for fine-tuning LLMs on consumer and enterprise GPUs

Hugging Face library for training language models with RLHF, SFT, and DPO

Swedish-hosted voice AI API with TTS, ASR, voice cloning, and conversational agents. ElevenLabs-compatible

Open-source framework for building real-time voice and multimodal AI agents over WebRTC

AI voice generator acquired by Meta (July 2025) and shut down (December 2025). See alternatives for text-to-speech.

Affordable speech-to-text and text-to-speech API with 100+ language support

Text-to-speech API with 200+ voices, sub-200ms latency, and on-premise deployment

Conversational AI platform for building enterprise AI agents

Community-driven multi-agent framework forked from AutoGen with backward-compatible API

Cloud browser infrastructure for AI agents with stealth mode, proxies, and session management

Managed cloud hosting for OpenClaw AI agents with dedicated VMs, browser automation, and messaging integrations

GDPR-compliant enterprise AI platform with multi-LLM access and agents