Discover AI Infrastructure Tools

Open-source PostgreSQL extension for vector similarity search alongside relational data

Open-source search and serving engine combining vector search, keyword search, and ML ranking at scale

Serverless vector and full-text search engine built on object storage for cost-efficient scale

The Most Widely-Adopted Vector Database.

A one-stop platform for building production ready LLM applications connected with your proprietary data.

AI gateway for routing to 1,600+ LLMs with observability, guardrails, and prompt management

Open-source CLI for testing, evaluating, and red-teaming LLM applications

Open source app for prompt testing

Collaborate on prompts, evaluate, and optimize LLM-powered Apps with Klu.

Eliminate risks of biases, performance issues & security holes in AI models. In <10 lines of code.

LLMOps platform for logging, debugging, and improving LLM-powered applications

AI evaluation and observability platform with hallucination detection and real-time guardrails

Open-source LLM observability built on OpenTelemetry, with automatic instrumentation for major providers and frameworks

Open-source LLM evaluation framework with 50+ metrics for testing agents, RAG, and chatbots

AI observability platform with tracing, evaluation, and monitoring for LLM and ML applications

Custom AI chip inference platform with purpose-built hardware for high-throughput LLM serving

Open-source serverless GPU cloud with sub-second cold starts and auto-scaling

GPU marketplace for renting compute at market-driven prices with per-second billing

Serverless fine-tuned LLM serving with LoRAX, serving thousands of adapters on a single GPU

GPU cloud infrastructure built for large-scale AI training and inference workloads

Multi-agent LLM framework using message-based task delegation inspired by the Actor model

Spring framework for building AI-powered Java applications with portable model and vector store abstractions

Microsoft's SDK for building and orchestrating AI agents in .NET, Python, and Java

Type-safe Python agent framework with Pydantic validation, tool calling, and dependency injection

Open-source TypeScript toolkit for building AI applications with streaming, tool calling, and agents

Declarative deep learning framework for building and fine-tuning models with YAML configuration

Enterprise LLM fine-tuning platform with Memory Tuning for near-zero hallucination

Open-source toolkit for fine-tuning LLMs with a single YAML config across the full training pipeline

Fine-tune LLMs up to 30x faster with 90% less memory usage

Build the next generation of creativity with fal. Lightning fast inference.

Open-source text-to-speech and voice cloning with low latency in 13+ languages

Empathic voice AI that detects and responds to human emotion in real-time

Real-time voice AI with ultra-low latency text-to-speech and voice cloning in 40+ languages

Speech-to-text APIs with audio intelligence, speaker diarization, and real-time streaming

Build Voice AI into your apps.

Lightweight Python agent framework from Hugging Face where agents write Python code instead of JSON tool calls

Framework for building stateful AI agents with persistent memory, formerly MemGPT

Tool integration platform connecting AI agents to 1,000+ apps with managed auth and execution

Low-level framework for building stateful, long-running AI agents with graph-based orchestration

Microsoft's framework for building multi-agent AI applications with event-driven messaging