≫ Home / Observability & Analytics / Portkey / Alternatives

Portkey Alternatives

AI gateway for routing to 1,600+ LLMs with observability, guardrails, and prompt management

Portkey is an AI infrastructure platform with an open-source AI gateway at its core.

Explore 39 alternatives to Portkey across 2 categories. Each tool listed below shares at least one category with Portkey.

📊 Observability & Analytics

Agenta

Open-source prompt management, evaluation, and observability for LLM apps

Open Source Free Trial

Arize AI

AI observability platform with tracing, evaluation, and monitoring for LLM and ML applications

Open Source Free Trial

Braintrust

Stop building AI in the dark.

Free Trial

Cekura

Testing and monitoring platform for AI voice and chat agents

Free Trial

Comet Opik

Comet provides an end-to-end model evaluation platform for AI developers.

Open Source Free Trial

Datadog LLM Observability

LLM tracing, evaluation, and prompt monitoring built into the Datadog APM platform

Free Trial

DeepEval

Open-source LLM evaluation framework with 50+ metrics for testing agents, RAG, and chatbots

Open Source Free Trial

Evidently AI

Open-source ML and LLM evaluation with 100+ built-in metrics and CI/CD integration

Open Source Free Trial

Galileo

AI evaluation and observability platform with hallucination detection and real-time guardrails

Free Trial

Giskard

Eliminate risks of biases, performance issues & security holes in AI models. In <10 lines of code.

Open Source Free Trial

Greptime

Gain comprehensive insights into the cost, performance, feedback, traces of your LLM applications.

Open Source Free Trial

Hamming AI

At-scale testing & production monitoring for AI voice agents

Helicone

Join thousands of startups and enterprises who use Helicone's Generative AI platform to monitor, collect data, and sc...

Open Source Free Trial

Honeyhive

AI Performance and Reliability, Delivered

Free Trial

Humanloop

Develop AI features with confidence

Free Trial

Klu

Collaborate on prompts, evaluate, and optimize LLM-powered Apps with Klu.

Free Trial

Langfuse

Traces, evals, prompt management and metrics to debug and improve your LLM application.

Open Source Free Trial

LangSmith

LangSmith is a unified DevOps platform for developing, collaborating, testing, deploying, and monitoring LLM applicat...

Free Trial

LangWatch

LLM observability platform with quality monitoring, guardrails, and evaluation workflows

Open Source Free Trial

Log10

LLMOps platform for logging, debugging, and improving LLM-powered applications

Free Trial

lunary

The platform to monitor, manage and improve your LLM apps.

Free Trial

Patronus AI

Detect LLM mistakes at scale and use generative AI with confidence

PromptLayer

Visually manage prompts. Evaluate models. Log LLM requests. Search usage history. Collaborate as a team.

Free Trial

Ragas

Open-source evaluation and testing framework for LLM and RAG applications

Open Source

Sentrial

Production monitoring for AI agents with automated failure detection and diagnosis

Free Trial

Traceloop

Open-source LLM observability built on OpenTelemetry, with automatic instrumentation for major providers and frameworks

Open Source Free Trial

Weights & Biases

ML experiment tracking, LLM observability, and evaluation platform for AI teams

Free Trial

✍️ Prompt engineering

Dify

Easily build and operate generative AI applications. Create Assistants API and GPTs based on any LLMs.

Open Source Free Trial

FinetuneDB

Capture production data, evaluate outputs collaboratively, and fine-tune your LLM's performance

Fixie

The fastest way to build conversational AI agents

Open Source Free Trial

Giskard

Eliminate risks of biases, performance issues & security holes in AI models. In <10 lines of code.

Open Source Free Trial

Klu

Collaborate on prompts, evaluate, and optimize LLM-powered Apps with Klu.

Free Trial

Knit

Professional prompt editors with gpt-4-turbo/vision, gemini-pro and more models, function call simulation and more!

Free Trial

Orq.ai

LLMOps platform for prompt management, evaluation, and AI governance

Free Trial

PromptFoo

Open-source CLI for testing, evaluating, and red-teaming LLM applications

Open Source Free Trial

PromptLayer

Visually manage prompts. Evaluate models. Log LLM requests. Search usage history. Collaborate as a team.

Free Trial

PromptLeo

Advanced prompt engineering platform for prompt engineers to create, test, and change prompts.

Free Trial

Prompt Mixer

Open source app for prompt testing

Open Source

Superagent

Prototype and deploy agents powered by large language models.

Open Source Free Trial

Is your product missing?

Add it here →