Back to vendors
L

LangWatch

Also known as: Langwatch

Visit site
Entry priceGrowth at €29 per core seat a month plus usage. Developer is free, the open source edition is free to self host, and Enterprise is custom.Full pricing detail

Open source platform for agent tracing, simulation-based agent testing and evaluation, with an AI gateway for routing and governance and Langy, an automated AI engineer that opens pull requests.

LangWatch is an open source platform for tracing, testing, routing and governing the LLM calls a company makes, from its own agents to the coding assistants its engineers use. Tracing is OpenTelemetry native across Python, TypeScript, Go and Java SDKs and integrations for major frameworks, providers and coding agents.

Its distinguishing feature is agent testing: scenarios in which a simulated user acts out a situation against the agent while a judge scores the conversation, grouped into test suites, run from the platform or in code, compared across agents, extended to voice agents and red teaming, and used as the quality gate when optimizing prompts and tool contracts.

Around that sit experiments over datasets, online monitors that score production traffic as it arrives, inline guardrails that block or modify responses, annotation queues, alerts and automations, and visual workflows that combine prompts, Python code, HTTP calls and evaluators and can be published as evaluators, agents or APIs. Langy, LangWatch's automated AI engineer, reads traces and evals, writes Scenario tests and opens pull requests through a GitHub App for a person to review.

The LangWatch AI Gateway gives one OpenAI- and Anthropic-compatible endpoint across a dozen providers, with virtual keys, routing policies and fallback order, budgets and rate limits, and governance features such as personal keys for coding assistants and OCSF export to a SIEM. LangWatch supports SSO, SCIM provisioning, custom roles, an audit log and per-scope retention, and states ISO 27001 certification and GDPR compliance. It runs as managed cloud in the EU, US, UK or APAC, self-hosted or in a hybrid setup. The Developer plan is free, Growth is €29 per core seat a month with events billed beyond the included amount, and Enterprise is custom.

Vendor details

Canonical URL

https://langwatch.ai

Category

Agent infrastructure

Subcategory

Observability and evaluation

Funding status

Independent. Open source under Apache 2.0 with an active project used by thousands of AI developers. Offers a managed cloud alongside self hosted, on premise, and hybrid deployment.

Company status

independent

Use cases & customers

Primary use cases

agent observabilityevaluation and scenario testingprompt managementgateway governance and cost control

Target customers

developersAI engineering teamsproduct teams

Deployment options

SaaSself-hostedon-premVPC

Integrations

OpenTelemetry native and framework and provider agnostic, with integrations for LangChain, LangGraph, CrewAI, the Vercel AI SDK, Mastra, and Google ADK. Usable through MCP clients like Claude Desktop, with a GitHub integration for prompt versioning and an OpenAI and Anthropic compatible gateway reaching hundreds of models.

In practice

Your agent passes eyeball checks but breaks in production. LangWatch runs multi turn simulations against it in parallel, scores them with a judge rubric, and turns failures into pull requests before launch.

A product manager needs to test agent behavior without code. They write the goal in plain English, LangWatch generates the scenario plan and rubric, and developers stay in flow while nothing slips through.

You want tracing plus cost control in one place. LangWatch gives OpenTelemetry native traces and an OpenAI and Anthropic compatible gateway with virtual keys, budgets, and provider fallback, self hosted if needed.

Agentic Index coverage score

10.0 / 14 capabilities · 71%

Integrations & Tool Calling Full

Langy, LangWatch's agent, changes code through pull requests that a GitHub App opens. LangWatch workflows, which can be published as agents or API endpoints, call outside systems through HTTP nodes and code blocks that use encrypted project secrets. The AI Gateway governs which tools and servers a virtual key may reach.

SourceLangWatch, langwatch.ai/docs/llms.txt (Langy pull requests, workflows, secrets, routing policies)read 2026-09-21

Workflow Orchestration Partial

A LangWatch workflow is a graph of nodes that runs from an Entry point to an End node, mixing LLM prompt nodes with Python code, HTTP and evaluator nodes. Versions are saved and can be restored, and a workflow can be published as an evaluator, as an agent under test, or as an API the customer's code calls. Workflows do not include loops, branching, retries or fallback paths.

SourceLangWatch, langwatch.ai/docs/workflows/overview and llms.txt (building a workflow, workflow as agent); langwatch.ai/docs/workflows/overview.mdread 2026-09-21

Knowledge Grounding & RAG Not documented

Built in RAG evaluators score retrieval, and cookbooks on embedding tuning and vector versus hybrid search help with the customer's own pipeline. LangWatch has no document ingestion, index, retrieval layer or knowledge API that grounds an agent in company data.

SourceLangWatch, langwatch.ai/docs/llms.txt (built-in evaluators, cookbooks)read 2026-09-21

Human Oversight & Guardrails Full

Guardrails run evaluators inline to block or modify harmful responses in real time, the AI Gateway enforces budgets, rate limits and routing policies, including which tools and servers a key may reach, before a request goes through, and Langy's code changes arrive as pull requests that a person reviews before merge.

SourceLangWatch, langwatch.ai/docs/llms.txt (guardrails, AI Gateway budgets and routing policies, Langy pull requests)read 2026-09-21

Security, Identity & Governance Full

Controls include single sign on with directory provisioning and sign in policies, SCIM 2.0 provisioning from Okta, Entra ID and others with group to role mapping, and role based access with custom roles and role bindings at organization, team and project level.

An audit log records every change made through settings, the API and the AI Gateway, with who, where and what changed, and exports to a SIEM in OCSF format. Retention is set per organization, team or project, and secrets are encrypted and write only. LangWatch states ISO 27001 certification and GDPR compliance, with a trust center monitored by Vanta.

SourceLangWatch, langwatch.ai/docs/llms.txt (SSO, SCIM, RBAC, audit log, data retention, secrets, OCSF export), langwatch.ai homepage and pricingread 2026-09-21

Observability & Auditability Full

LangWatch traces LLM calls, tool executions and retrieval steps through OpenTelemetry native SDKs and integrations, including coding assistants such as Claude Code and Codex. An audit log records every change through settings, the API and the gateway, governance events export to a SIEM as OCSF records, and analytics export into the customer's dashboards. Default retention is published per plan and can be adjusted per organization, team or project.

SourceLangWatch, langwatch.ai/docs/llms.txt (observability, audit log, OCSF export, data retention) and langwatch.ai/docs/pricingread 2026-09-21

Memory & State Persistence Not documented

Traces, threads and datasets are stored as records of the customer's agent, and each Langy conversation runs in its own sandboxed worker. Agents have no session, workflow or long term memory that they read and write across runs.

SourceLangWatch, langwatch.ai/docs/llms.txt (concepts, datasets, how Langy works)read 2026-09-21

Deployment & Data Residency Full

Customers can run LangWatch as managed multi tenant SaaS in the EU, US, UK or APAC, self hosted with Docker, Kubernetes and Helm or in their own VPC, or hybrid, with the data plane on their infrastructure and the control plane on LangWatch's. The open source repository includes every feature for local use, and an Enterprise license adds longer retention to self hosted deployments.

SourceLangWatch, langwatch.ai homepage and langwatch.ai/docs/llms.txt (self-hosting overview, editions and licensing, hybrid setup)read 2026-09-21

Prebuilt Agents, Templates & Packs Partial

LangWatch ships Langy, an automated AI engineer that reads traces and evals, writes Scenario tests, optimizes prompts and opens pull requests, and a Skills Directory of installable skills, including skills for product managers and domain experts, that set a coding assistant up to work with LangWatch. There is one packaged agent and a set of setup skills, but no set of ready made agents or workflow templates to choose from.

SourceLangWatch, langwatch.ai/docs/llms.txt (Langy, skills directory) and langwatch.ai homepageread 2026-09-21

Triggers & Channel Coverage Full

Online evaluation monitors run an evaluator on every matching trace or thread as it arrives, alerts and automations catch regressions and notify teams, automations add every new trace matching a filter to a dataset, and Langy can set up alerts and automations from what it finds across traces. Scoring and actions start on incoming traffic without anyone asking.

SourceLangWatch, langwatch.ai/docs/llms.txt (online evaluation, alerts and automations, datasets from traces, Langy insights)read 2026-09-21

Model Flexibility & Routing Full

The LangWatch AI Gateway offers one endpoint, compatible with OpenAI and Anthropic, across providers including OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Vertex AI, Gemini, xAI, Groq, Cerebras and DeepSeek. Provider credentials are held in LangWatch, each application gets a virtual key, and routing policies set which providers a key routes through, the fallback order and model tiers, with budgets and rate limits enforced before the request. Model providers are stored once per organization, team or project for evaluators, workflows and Langy.

SourceLangWatch, langwatch.ai/docs/llms.txt (AI Gateway, routing policies, budgets, providers, model providers)read 2026-09-21

APIs, SDKs & MCP Extensibility Full

LangWatch offers a REST API, including the Workflows and Instant Evals APIs, SDKs in Python, TypeScript, Go and Java, and the langwatch CLI, which drives the platform from the terminal for people and coding assistants. An MCP server gives coding assistants access to traces, tests and evaluations, alongside installable skills, personal and service API keys for development and CI/CD, and CI integration that gates merges on eval results.

SourceLangWatch, langwatch.ai/docs/llms.txt (CLI, MCP server, API keys, API reference) and langwatch.ai/pricingread 2026-09-21

Testing, Debugging & Optimization Full

Experiments run over datasets with built in, saved and workflow built evaluators. LangWatch also tests agents with multi turn scenarios in which a simulated user acts against the agent and a judge scores the conversation. It groups scenarios into test suites, compares agents side by side on pass rate, cost and latency, gates merges on eval results in CI, scores production traffic with online monitors, and optimizes prompts and tool contracts with the scenario suite as the quality gate.

SourceLangWatch, langwatch.ai/docs/llms.txt (agent testing, evaluations, improve your agent) and langwatch.ai/pricingread 2026-09-21

Browser & Computer Use Not documented

The product covers tracing, agent testing, evaluation, the AI Gateway, governance, Langy and self hosting, and no agent controls a browser, desktop or computer. Langy works in a sandbox through the CLI and code.

SourceLangWatch, langwatch.ai/docs/llms.txtread 2026-09-21

The Agentic Index coverage score grades every vendor Full, Partial or Not documented against the same 14 buyer facing capabilities, from public evidence only. Each capability links to how all vendors in the index score on it. How this evidence is graded

Product updates

·Observability / auditabilityVerified

Organization admins in LangWatch can now create a governance project that reads, read only, the traces of every personal project, the personal projects in one department, or projects they pick, which is where developers' coding agents send their traces. Only admins can create or open these projects, every visit is recorded in the audit log, and the strictest data privacy policy among the source projects applies.

Bears on: Security / enterprise

View source
·Observability / auditabilityVerified

Instant Evals now live in LangWatch's Trace Explorer search bar. A question no filter can express, such as whether the user sounds frustrated, becomes an LLM judged filter chip that combines with the others. Runs under $0.50 start on their own, and bigger ones ask first.

Bears on: Observability / auditability

View source
·Observability / auditabilityVerified

LangWatch introduced Langy, an automated AI engineering agent embedded directly inside the platform. Langy analyzes production traces to identify and cluster recurring behavior patterns, automatically writes scenario tests and evaluations, and opens pull requests on connected GitHub repositories to propose code fixes.

Bears on: Observability / auditability

View source
View all 3 LangWatch updates →Tracked since Jul 2026 · Verified from public vendor sources

Pricing

Growth at €29 per core seat a month plus usage. Developer is free, the open source edition is free to self host, and Enterprise is custom.

Per core seat plus events beyond the included amount, plus storage beyond the included retention

Free tierTrial available

Included quota

The open source edition is free to self host with the full feature set. The free Developer cloud plan includes 50k events a month, 14 day data access, 2 users and 3 each of scenarios, simulations and custom evals. Growth includes 200,000 events a month at €29 per core seat, with unlimited lite seats for sharing results.

What is public

The free event allowance, per seat euro price, and event overage rate are published.

Billing mechanics

Free open source self hosting, or cloud with a free Developer plan of 50k events a month and Growth at €29 per core seat a month, with unlimited lite seats for viewers. Growth includes 200,000 events, and events beyond that bill at €5 per 100k. Plans can be upgraded, downgraded or canceled at any time.

Cost watchouts

Evaluation results and every experiment row and simulation turn count as billable events alongside spans, so heavy testing moves past the included 200k events faster than traces alone. Events beyond it cost €5 per 100k and storage beyond 30 days €3 per GB.

Variable cost rationale

LangWatch meters events and storage on top of core seats. Every trace, evaluation result, experiment row and simulation turn is an event, so testing and production volume both grow the bill once Growth's included 200k events a month are used. Events beyond that cost €5 per 100k, and data kept beyond 30 days €3 per GB. Core seats are a fixed monthly charge, lite users are unlimited, and volume discounts apply above 20 users. No spending cap is published. Self hosting the open source edition removes the event meter and leaves the customer's own infrastructure cost.

Overage / add-ons

Events above the included allowance cost €5 per 100k on Growth, and storage beyond the included 30 day retention €3 per GB.

Sales call required

Mixed (some tiers require a call)

Free / trial

Developer plan free forever with 50k events a month, 14 day data access and 2 users, no card. Growth has a free trial, and the open source edition is free to self host.

Lowest paid plan

Growth at €29 per core seat a month plus usage

Commercial notes

Open source, with every feature in the repository that customers can self host. The cloud plans charge per core seat with unlimited lite users for reviewers and stakeholders, and events cover traces, evaluations, experiments and simulations.

Key ambiguities

Growth includes 30 day retention on the pricing page, while the documentation's pricing page gives every plan a 49 day default. Seat prices are quoted in euros, with a dollar toggle.

Cancellation / refund

Plans can be upgraded, downgraded or canceled at any time. Enterprise has custom terms and a DPA.

Support SLA / resale

Developer has community support on GitHub and Discord, Growth private Slack or Teams support, and Enterprise a forward deployed engineer and SLAs. Enterprise can be billed through the AWS or Google marketplaces.

Agentic Index verified 2026-09-21

Alternatives to LangWatch

The closest documented capability profiles to LangWatch among agent infrastructure platforms tracked by Agentic Index, ordered by similarity on the same 14 point evidence the rankings use. No vendor pays for placement.

  • Braintrust10.0 / 14Matches LangWatch across all 14 documented capabilities
  • F5 AI Guardrails9.0 / 14A lighter documented profile than LangWatch
  • Galileo9.0 / 14A lighter documented profile than LangWatch
  • Opik9.0 / 14A lighter documented profile than LangWatch
  • W&B Weave9.0 / 14A lighter documented profile than LangWatch
  • Bernstein10.5 / 14Adds documented Memory & State Persistence

Similarity is computed from each vendor's Agentic Index coverage score evidence, axis by axis, not from the totals. How this evidence is graded

Contact us

Found a vendor we missed? Have feedback on the index? We'd love to hear from you.