Observability & Monitoring
LLM tracing, drift detection and production monitoring.
13 vendors in this category
Aporia
Observability & Monitoring
AI control platform with guardrails observability and security
Israel
Arize AI
Eval & Testing
Agent observability evaluation and improvement platform with open-source Phoenix
USA
Datadog LLM Observability
Observability & Monitoring
Enterprise LLM monitoring and observability within Datadog platform
USA
Fiddler AI
Observability & Monitoring
Enterprise AI observability security and control plane platform
USA
Galileo
Analytics & Conversation Intelligence
AI observability and evaluation platform that turns offline evals into production guardrails for AI systems
Helicone
Observability & Monitoring
Open-source LLM observability and AI gateway for developers
USA
Langfuse
Observability & Monitoring
Open-source LLM engineering platform for tracing evaluation and monitoring
Germany
LangSmith
Observability & Monitoring
LLM observability tracing and evaluation platform by LangChain
USA
Maxim AI
Eval & Testing
End-to-end evaluation and observability platform for AI agents
India/USA
MLflow (Databricks)
Observability & Monitoring
Open-source ML lifecycle platform with LLM tracing and evaluation
USA
Opik
Open Source Projects
Open-source LLM evaluation platform for debugging, evaluating, and monitoring LLM applications and RAG systems
Portkey
Developer APIs & Frameworks
Production stack for GenAI builders with AI Gateway, Observability, Guardrails, Governance, and Prompt Management in one platform
TruLens / TruEra
Eval & Testing
Open-source LLM evaluation and tracing framework (TruEra acquired by Snowflake)
USA