Discover AI Infrastructure Tools

Open-source search and serving engine combining vector search, keyword search, and ML ranking at scale

Serverless vector and full-text search engine built on object storage for cost-efficient scale

Vector search and kNN queries built into the established Elasticsearch platform

Open-source PostgreSQL extension for vector similarity search alongside relational data

A one-stop platform for building production ready LLM applications connected with your proprietary data.

LLMOps platform for prompt management, evaluation, and AI governance

AI gateway for routing to 1,600+ LLMs with observability, guardrails, and prompt management

Open-source CLI for testing, evaluating, and red-teaming LLM applications

Open source app for prompt testing

Collaborate on prompts, evaluate, and optimize LLM-powered Apps with Klu.

LLM observability platform with quality monitoring, guardrails, and evaluation workflows

Open-source ML and LLM evaluation with 100+ built-in metrics and CI/CD integration

LLM tracing, evaluation, and prompt monitoring built into the Datadog APM platform

LLMOps platform for logging, debugging, and improving LLM-powered applications

AI evaluation and observability platform with hallucination detection and real-time guardrails

Multi-LLM API orchestration platform for comparing and blending AI models

European GPU cloud for AI training and inference by Northern Data Group

European AI inference gateway with smart routing across EU providers

European serverless AI inference APIs, 100% hosted in Europe

European cloud provider with AI inference, training, and deployment services

Open-source agent development kit from Google for building multi-agent systems

TypeScript-first AI framework for building agents, RAG pipelines, and workflows

Multi-agent LLM framework using message-based task delegation inspired by the Actor model

Spring framework for building AI-powered Java applications with portable model and vector store abstractions

Microsoft's SDK for building and orchestrating AI agents in .NET, Python, and Java

Open-source fine-tuning framework for 100+ LLMs with a web UI

PyTorch-native library for fine-tuning LLMs on consumer and enterprise GPUs

Hugging Face library for training language models with RLHF, SFT, and DPO

Declarative deep learning framework for building and fine-tuning models with YAML configuration

Enterprise LLM fine-tuning platform with Memory Tuning for near-zero hallucination

Fast speech-to-text API with real-time transcription and speaker diarization

Low-latency text-to-speech API built for real-time conversational AI

Enterprise speech-to-text API supporting 55+ languages with high accuracy

Open-source text-to-speech and voice cloning with low latency in 13+ languages

Empathic voice AI that detects and responds to human emotion in real-time

GDPR-compliant enterprise AI platform with multi-LLM access and agents

AI workflow automation with 400+ integrations and native AI agents

The operating system for AI agents

Official OpenAI framework for building production AI agents with tool use and guardrails

Lightweight Python agent framework from Hugging Face where agents write Python code instead of JSON tool calls