Observability & Monitoring

LLM tracing, drift detection and production monitoring.

13 vendors in this category

A

Aporia

Observability & Monitoring

AI control platform with guardrails observability and security

Israel
A

Arize AI

Eval & Testing

Agent observability evaluation and improvement platform with open-source Phoenix

USA
D

Datadog LLM Observability

Observability & Monitoring

Enterprise LLM monitoring and observability within Datadog platform

USA
F

Fiddler AI

Observability & Monitoring

Enterprise AI observability security and control plane platform

USA
Galileo

Galileo

Analytics & Conversation Intelligence

AI observability and evaluation platform that turns offline evals into production guardrails for AI systems

Horizontal (Industry Agnostic)
H

Helicone

Observability & Monitoring

Open-source LLM observability and AI gateway for developers

USA
L

Langfuse

Observability & Monitoring

Open-source LLM engineering platform for tracing evaluation and monitoring

Germany
L

LangSmith

Observability & Monitoring

LLM observability tracing and evaluation platform by LangChain

USA
M

Maxim AI

Eval & Testing

End-to-end evaluation and observability platform for AI agents

India/USA
M

MLflow (Databricks)

Observability & Monitoring

Open-source ML lifecycle platform with LLM tracing and evaluation

USA
Opik

Opik

Open Source Projects

Open-source LLM evaluation platform for debugging, evaluating, and monitoring LLM applications and RAG systems

Horizontal (Industry Agnostic)
Portkey

Portkey

Developer APIs & Frameworks

Production stack for GenAI builders with AI Gateway, Observability, Guardrails, Governance, and Prompt Management in one platform

Horizontal (Industry Agnostic)
T

TruLens / TruEra

Eval & Testing

Open-source LLM evaluation and tracing framework (TruEra acquired by Snowflake)

USA