Back to vendors
T

Traceloop

Also known as: OpenLLMetry, Traceloop Hub

Visit site
Entry priceFree up to 50,000 spans a month · Enterprise customFull pricing detail

Maintainer of OpenLLMetry, the Apache 2.0 OpenTelemetry standard for LLM observability, plus a managed platform adding dashboards, evals, production monitors and experiments over managed datasets, deployable air gapped.

Traceloop is an observability and evaluation platform for LLM applications and agents, built on OpenTelemetry. Its open-source OpenLLMetry SDK, Apache-2.0 licensed with Python, TypeScript, Go and Ruby versions, traces every model and vector database call as standard OpenTelemetry spans with sessions, workflow annotations, versions and user feedback, and can send them to Traceloop or to more than twenty-five other backends such as Datadog, Dynatrace, Grafana, Splunk and New Relic, so switching backends does not mean re-instrumenting.

The Traceloop platform adds monitoring dashboards, a library of built-in evaluators for faithfulness, relevance, safety and agent behavior such as goal completion and tool selection, custom LLM-as-a-judge evaluators trained on annotated examples, monitors that run evaluators on production spans in real time, experiments over managed datasets that can run in CI with results posted to pull requests, a prompt registry, and guardrails applied through an SDK decorator that block unsafe or off-policy output before it reaches users. Hub, an OpenTelemetry-based gateway, routes model calls across the providers and models a customer configures and switches between them by availability.

Traceloop runs as a managed cloud, as a hybrid deployment that keeps trace data on the customer's infrastructure, or fully self-hosted on Kubernetes in AWS, GCP, Azure or air-gapped environments. The free plan covers 50,000 spans a month, and Enterprise adds volume, custom retention and on-prem deployment. ServiceNow completed its acquisition of Traceloop in 2026, and Traceloop's technology is becoming part of ServiceNow's AI Control Tower; OpenLLMetry stays open source, and Traceloop says it continues to sell the Traceloop product.

Vendor details

Canonical URL

https://www.traceloop.com

Category

Agent infrastructure

Company status

acquired

Use cases & customers

Primary use cases

Tracing LLM and agent calls as OpenTelemetry spans with OpenLLMetryBuilt in and custom evaluators for faithfulness, relevance and safetyProduction monitors that score live traffic and catch quality dropsEvaluation experiments in CI with results posted to pull requestsRouting model calls across providers through the Hub gateway

Target customers

teams with an existing OpenTelemetry stackregulated healthcare and financial servicesAI engineering teams avoiding vendor lock in

Deployment options

managed cloudself-hostedair-gappedexport to any OTel backend

In practice

You already run Datadog, Grafana or Splunk and do not want a second observability tool. OpenLLMetry pipes LLM traces into the stack you have instead of asking you to adopt another dashboard.

Your compliance regime rules out SaaS observability entirely. Traceloop can run fully self hosted on Kubernetes, including in air gapped environments, and says it is SOC 2 and HIPAA compliant.

A failure in production is hard to reproduce in testing. Monitors score production spans with the same evaluators your experiments use, and experiments over managed datasets run on every pull request, so the fix can be verified instead of assumed.

Agentic Index coverage score

8.0 / 14 capabilities · 57%

Integrations & Tool Calling Partial

OpenLLMetry instruments more than twenty model providers, vector databases such as Pinecone and Chroma and frameworks such as LangChain, LlamaIndex and CrewAI, exports to more than twenty-five observability backends, and Traceloop connects to Posthog, Slack and GitHub. These bring the customer's agent telemetry in and send results out. The customer's agent calls its own tools, and Traceloop names no integration through which an agent reads or writes a real system.

SourceTraceloop, traceloop.com/docs supported integrations, integrations overview, Posthog, Slack and GitHubread 2026-09-21

Workflow Orchestration Not documented

Customers build their applications in their own code or frameworks, and Traceloop observes and evaluates them but names no sequencing, branching, retries or routing of agent steps that it runs itself. Traceloop Hub runs plugin pipelines around each model request.

SourceTraceloop, traceloop.com/docs Hub configuration and introductionread 2026-09-21

Knowledge Grounding & RAG Not documented

Vector database calls are traced, and evaluators check whether retrieved context answers the question. Traceloop names no document ingestion, index, retrieval layer or knowledge API that grounds an agent in company data.

SourceTraceloop, traceloop.com/docs introduction and evaluatorsread 2026-09-21

Human Oversight & Guardrails Full

Guardrails are evaluators applied through the SDK's @guardrail decorator. They run synchronously before an output returns, intercept and block or modify unsafe, off policy or low quality responses, stack in layers for input, output and context checks, and log every execution for audit.

SourceTraceloop, traceloop.com/docs guardrailsread 2026-09-21

Security, Identity & Governance Partial

By its own account the platform is SOC 2 and HIPAA compliant, the Enterprise plan includes SOC 2 Compliance, and a trust center sits at trust.traceloop.com. Traceloop names no SSO, SAML, role model or permission scheme. Privacy controls include custom data retention on Enterprise, per user controls over logging prompts and responses, and an API to delete a user's trace data. Those controls govern what is logged and kept, not who inside the customer's organization can do what.

SourceTraceloop, traceloop.com/pricing and docs.traceloop.com privacy APIread 2026-10-01

Observability & Auditability Full

Every LLM and vector database call is traced as OpenTelemetry spans by the open source OpenLLMetry SDK, with workflow and task annotations, sessions for multi turn conversations, workflow and prompt versions, user feedback and multimodal logging. The traces flow to the Traceloop platform or to Datadog, Dynatrace, Grafana, Splunk, New Relic and other OpenTelemetry backends, and a spans API returns them programmatically. Retention is 24 hours on the free plan and custom on Enterprise.

SourceTraceloop, traceloop.com/docs sessions, annotations, integrations overview and get spans API, and traceloop.com/pricingread 2026-09-21

Memory & State Persistence Not documented

Traces, sessions, datasets and experiment results are stored for observability and testing. Traceloop names no session, workflow or long term memory that a customer's agent reads and writes through it.

SourceTraceloop, traceloop.com/docs sessions and datasetsread 2026-09-21

Deployment & Data Residency Full

Customers choose among three deployment routes. The first is a managed cloud. In a hybrid deployment, all trace data stays on the customer's infrastructure while Traceloop runs the processing and dashboard. The full platform can be self hosted on Kubernetes in AWS, GCP, Azure or any cluster, including air gapped environments. OpenLLMetry can also send data to a backend the customer already runs instead.

SourceTraceloop, traceloop.com/docs self-hosting overview, hybrid and full deployment, and traceloop.com/pricingread 2026-09-21

Prebuilt Agents, Templates & Packs Not documented

Automatic instrumentations for providers, vector databases and frameworks ship with Traceloop, along with a library of preconfigured evaluators. Traceloop names no ready made agents, templates or packaged workflows a customer adopts for its own work.

SourceTraceloop, traceloop.com/docs made by Traceloop evaluators and supported integrationsread 2026-09-21

Triggers & Channel Coverage Full

Monitors run an evaluator in real time on every production span that matches a filter, and auto monitor setups create monitors programmatically. The Slack integration sends daily or weekly updates on a schedule, and experiments run on each pull request through GitHub.

SourceTraceloop, traceloop.com/docs monitors, Slack and GitHub integrationsread 2026-09-21

Model Flexibility & Routing Full

Traceloop Hub is a gateway that takes the customer's own providers and models, including the same model on different providers such as GPT-4o on Azure and on OpenAI. Its pipelines use a model-router plugin that routes each request across the listed models and switches between them according to availability. The playground and experiments run prompts with full model configuration. The customer chooses the models, and the fallback policy sits in its own Hub configuration.

SourceTraceloop, traceloop.com/docs Hub configuration and getting startedread 2026-09-21

APIs, SDKs & MCP Extensibility Full

A REST API with a published OpenAPI specification covers spans, costs, metrics, evaluators, auto monitor setups, organizations and privacy requests. The Apache-2.0 OpenLLMetry SDKs for Python, TypeScript, Go and Ruby also emit standard OpenTelemetry that any compatible backend consumes. Experiments run from CI through the GitHub integration, so the API and SDKs fit into a CI/CD pipeline.

SourceTraceloop, traceloop.com/docs API reference, OpenLLMetry getting started and GitHub integrationread 2026-09-21

Testing, Debugging & Optimization Full

Experiments run over managed datasets from the SDK or in CI, posting evaluation results into GitHub pull requests. Outputs are scored with a library of built in evaluators for faithfulness, relevance, agent goal completion, tool selection and trajectory, and with custom LLM-as-a-judge evaluators trained on annotated examples. The same evaluators run continuously on production traffic as monitors.

SourceTraceloop, traceloop.com/docs experiments, GitHub integration, evaluators and monitorsread 2026-09-21

Browser & Computer Use Not documented

The product covers tracing, evaluation, monitoring, guardrails, prompt management and a model gateway. Traceloop names no browser, desktop or computer control by an agent.

SourceTraceloop, traceloop.com/docs llms.txt and introductionread 2026-09-21

The Agentic Index coverage score grades every vendor Full, Partial or Not documented against the same 14 buyer facing capabilities, from public evidence only. Each capability links to how all vendors in the index score on it. How this evidence is graded

Pricing

Free up to 50,000 spans a month · Enterprise custom

Spans ingested on the managed platform (every LLM and vector database call is a span); free up to 50,000 a month, Enterprise above that; nothing if spans go to the customer's own backend

Free tierTrial available

What is public

The OpenLLMetry license and scope are public on GitHub. The pricing page publishes the Free Forever plan (50,000 spans a month, up to 5 seats, 24 hour retention) and an Enterprise plan sold by conversation.

Billing mechanics

Two independent paths. The OpenLLMetry instrumentation library is Apache 2.0 and free with no vendor relationship required, emitting standard OpenTelemetry spans to whatever backend the customer already runs. Traceloop's managed platform is the commercial product, adding dashboards, alerting and evaluation, with a free plan to 50,000 spans a month and an Enterprise plan above it. Air gapped and regulated deployments are enterprise terms.

Cost watchouts

The free plan keeps data for 24 hours, so any production use with history needs Enterprise; spans routed to Datadog, New Relic or another backend instead move the ingestion cost to that vendor.

Variable cost rationale

Managed platform spend depends on span volume above the free 50,000, on Enterprise terms; a team can instead send OpenLLMetry spans to infrastructure it already pays for, which caps exposure to the managed platform.

Additional watchouts

The free library is genuinely free, but observability cost does not vanish when you route elsewhere: LLM traces are verbose and ingestion charges land on Datadog, New Relic or Honeycomb instead. Model the destination backend's ingestion pricing alongside Traceloop's, not instead of it.

Overage / add-ons

Managed platform consumption metered on spans ingested above the free allowance

Sales call required

Mixed (some tiers require a call)

Free / trial

Free Forever plan up to 50,000 spans a month; a free 14-day trial is offered alongside the cloud marketplace listings

Lowest paid plan

Not published; Enterprise is by conversation or through the AWS, GCP and Azure marketplaces

Commercial notes

Traceloop gives away the OpenLLMetry instrumentation SDK and sells the managed platform, with a free plan to 50,000 spans a month and an Enterprise plan for volume, retention and on-prem or air-gapped deployment, also purchasable through the three cloud marketplaces. ServiceNow completed its acquisition of Traceloop in 2026, and Traceloop says it continues to sell the Traceloop product.

Key ambiguities

No paid self-serve tier or Enterprise price is published. The plan card lists up to 5 seats on the free plan while the FAQ on the same page says there is no seat limit.

Missing data

Enterprise rates and span allowances, and pricing for air gapped or self hosted enterprise deployment.

Agentic Index verified 2026-09-21

Alternatives to Traceloop

The closest documented capability profiles to Traceloop among agent infrastructure platforms tracked by Agentic Index, ordered by similarity on the same 14 point evidence the rankings use. No vendor pays for placement.

  • Fiddler AI8.5 / 14Fuller documented coverage on Security, Identity & Governance
  • F5 AI Guardrails9.0 / 14Adds documented Prebuilt Agents, Templates & Packs
  • Freeplay8.0 / 14Fuller documented coverage on Security, Identity & Governance
  • Galileo9.0 / 14Adds documented Prebuilt Agents, Templates & Packs
  • Helicone8.0 / 14Fuller documented coverage on Security, Identity & Governance
  • Opik9.0 / 14Adds documented Prebuilt Agents, Templates & Packs

Similarity is computed from each vendor's Agentic Index coverage score evidence, axis by axis, not from the totals. How this evidence is graded

Contact us

Found a vendor we missed? Have feedback on the index? We'd love to hear from you.