AgentOps
Also known as: AgentOps.ai
Agent observability and debugging platform: open source SDKs trace LLM calls, tools and multi-agent runs for step-by-step replay and cost tracking across 400+ models, with a public API, MCP server and self-hosting.
AgentOps is a developer platform for tracing and debugging AI agents and LLM applications. After about two lines of code, its Python or TypeScript SDK records the LLM calls, tool calls and operations an agent makes as a trace of spans, and the dashboard replays each run step by step with point-in-time precision, visualizes multi-agent interactions, and tracks tokens and cost across more than 400 models. It keeps a data trail of logs, errors and prompt injection attempts, integrates natively with agent frameworks such as AG2, Agno, CrewAI, the OpenAI Agents SDK, LangChain and LlamaIndex, and exposes trace data through a read-only public API and an MCP server.
The platform can be self-hosted, with the API server, dashboard and data layers running on the customer's own servers or cloud through Docker Compose, Kubernetes or AWS, GCP and Azure. The hosted service is free up to 5,000 events, Pro starts at $40 a month on a pay-as-you-go basis with unlimited events, log retention, export and role-based permissions, and Enterprise adds custom SSO, on-premise deployment and custom retention. AgentOps also offers fine-tuning of specialized models on saved completions and expert help building agents.
Vendor details
Canonical URL
https://www.agentops.ai
Category
Agent infrastructure
Subcategory
Agent observability & evaluation
Funding status
Seed-stage; ~$2.6M raised (2024) under parent company Agency (Staf.ai).
Company status
independent
Use cases & customers
Primary use cases
Target customers
Deployment options
Integrations
Python and TypeScript SDK that instruments agents in about two lines of code. Native integrations with CrewAI, AutoGen/AG2, the OpenAI Agents SDK, LangChain, LlamaIndex, CAMEL, Agno, SwarmZero, and Google ADK, plus cost and usage tracking across 400+ LLMs. Built on OpenTelemetry-style spans, so traces can route into existing observability stacks.
In practice
An agent run goes wrong in production and you have no idea which step broke. AgentOps records every LLM call, tool use, and decision as a session trace you can replay step by step.
Your agent stack spans several frameworks and none of them monitor the others. AgentOps integrates natively with CrewAI, AutoGen, LangChain, LlamaIndex, and the OpenAI Agents SDK, so one tool covers them all.
Token spend creeps up and you can't see where. AgentOps tracks tokens and cost across more than 400 models, so the bill isn't a mystery.
Sources & related URLs
Related / legacy domains
Agentic Index coverage score
5.0 / 14 capabilities · 36%
| Integrations & Tool Calling | Partial |
|---|---|
|
The major agent frameworks and providers are instrumented natively, including AG2, Agno, CrewAI, the OpenAI Agents SDK, LangChain and LlamaIndex, and AgentOps traces the tool calls those agents make. These bring trace data in; no integration connects an agent to a real system to take actions. SourceAgentOps, docs.agentops.ai/llms.txt (integrations) and agentops.ai homepageread 2026-09-21 |
|
| Workflow Orchestration | Not documented |
|
Multi-agent workflows the customer runs are visualized from their traces, with operations associated to named agents. No workflows that sequence, branch or retry steps, or combine deterministic nodes with agent steps, are documented as something AgentOps runs. SourceAgentOps, docs.agentops.ai/llms.txt (tracking agents, recording operations) and agentops.ai homepageread 2026-09-21 |
|
| Knowledge Grounding & RAG | Not documented |
|
Calls a customer's agents make are traced, including retrieval steps where the customer instruments them. No document ingestion, index, retrieval layer or knowledge API that grounds an agent in company data is documented. SourceAgentOps, docs.agentops.ai/llms.txtread 2026-09-21 |
|
| Human Oversight & Guardrails | Not documented |
|
Logs, errors and prompt injection attacks leave a data trail, and runs can be replayed for review. No approval step, consent checkpoint, runtime guardrail or pause and resume control over an agent's actions is documented. SourceAgentOps, agentops.ai homepage and docs.agentops.ai/llms.txtread 2026-09-21 |
|
| Security, Identity & Governance | Partial |
|
The Pro plan adds role-based permissioning and the Enterprise plan lists custom SSO, a custom data retention policy and on-premise or self-hosted deployment, and self-hosting lets a customer apply its own security policies. Compliance names appear in the pricing section without a published report or auditor behind them. SourceAgentOps, agentops.ai homepage pricing section and docs.agentops.ai/v2/self-hosting/overviewread 2026-09-21 |
|
| Observability & Auditability | Full |
|
Each agent run is recorded as a trace of spans for LLM calls, tool calls, operations and named agents, with the host environment captured automatically, and the dashboard replays runs step by step with point-in-time precision, visualizes multi-agent interactions and tracks tokens and cost; the Pro plan adds session and event export and unlimited log retention, and a read-only public API and MCP server expose trace and span data. SourceAgentOps, docs.agentops.ai/llms.txt (traces, spans, host environment, public API, MCP server) and agentops.ai homepageread 2026-09-21 |
|
| Memory & State Persistence | Not documented |
|
Traces, sessions and completions are stored as records of the customer's agent runs. No session, workflow or long term memory that an agent reads and writes is documented. SourceAgentOps, docs.agentops.ai/llms.txt (traces, core concepts)read 2026-09-21 |
|
| Deployment & Data Residency | Full |
|
Two modes are offered, the hosted service or self-hosting, with the whole platform (API server, dashboard, Supabase and ClickHouse data layers and an OpenTelemetry collector) on the customer's own servers or cloud through Docker Compose, Kubernetes or deployment to AWS, GCP and Azure, keeping data on the customer's infrastructure; the Enterprise plan lists on-premise deployment, self-hosting on AWS, GCP and Azure, and a custom data retention policy. SourceAgentOps, docs.agentops.ai/v2/self-hosting/overview and agentops.ai homepage; docs.agentops.ai/v2/self-hosting/overview.mdread 2026-09-21 |
|
| Prebuilt Agents, Templates & Packs | Not documented |
|
AgentOps documents examples of instrumenting agents built with various frameworks and offers expert help building agents as a service. No ready-made agents, templates or packaged workflows a buyer adopts are documented. SourceAgentOps, agentops.ai homepage and docs.agentops.ai/llms.txt (examples)read 2026-09-21 |
|
| Triggers & Channel Coverage | Not documented |
|
When the customer's instrumented code runs, traces arrive and appear in the dashboard. No schedule, event trigger, alert or automation that starts work without a person initiating it is documented. SourceAgentOps, docs.agentops.ai/llms.txt and agentops.ai homepageread 2026-09-21 |
|
| Model Flexibility & Routing | Partial |
|
More than 400 LLMs and frameworks that a customer's agents call can be traced and costed, without constraining which model the agent uses. No model the product itself runs is chosen, routed or keyed by the customer, and no model policy is documented. SourceAgentOps, agentops.ai homepage and docs.agentops.ai/llms.txt (tracking LLM calls)read 2026-09-21 |
|
| APIs, SDKs & MCP Extensibility | Full |
|
AgentOps publishes open source Python and TypeScript SDKs with decorators, context managers and manual trace control, a read-only HTTP public API for trace and span data, and an MCP server that exposes trace and span data to MCP clients, alongside an MCP docs server. SourceAgentOps, docs.agentops.ai/llms.txt (SDK reference, TypeScript SDK, public API, MCP server)read 2026-09-21 |
|
| Testing, Debugging & Optimization | Partial |
|
Agents are debugged by rewinding and replaying runs with point-in-time precision, a data trail of errors and prompt injection attempts is kept, and AgentOps offers fine-tuning of specialized models on saved completions as an optimization step after deployment. Testing against fixtures or datasets, configurable quality gates and scoring of output quality over time are not documented. SourceAgentOps, agentops.ai homepage and docs.agentops.ai/llms.txtread 2026-09-21 |
|
| Browser & Computer Use | Not documented |
|
AgentOps documents SDK instrumentation, tracing, the dashboard, a public API, an MCP server and self-hosting, and no browser, desktop or computer control by an agent is documented. SourceAgentOps, docs.agentops.ai/llms.txtread 2026-09-21 |
|
The Agentic Index coverage score grades every vendor Full, Partial or Not documented against the same 14 buyer facing capabilities, from public evidence only. Each capability links to how all vendors in the index score on it. How this evidence is graded
Pricing
Free up to 5,000 events · Pro from $40/mo · Enterprise custom
usage
Included quota
Free tier is event capped; an event is each tracked LLM call, tool call, or action, so a single agent run can emit a dozen or more events and the free tier suits evaluation rather than production. Compliance (SOC 2, HIPAA, NIST AI RMF), self hosting, and SSO are Enterprise gated.
What is public
A free tier, a self serve paid tier, and a custom Enterprise tier are consistently confirmed across sources, as is the MIT licensed open source SDK and app. Exact current tier numbers are not reliably public.
Billing mechanics
Event metered freemium: tracked events deduct from plan quotas, with Enterprise handling compliance, self hosting, and SLAs.
Cost watchouts
Pro is pay as you go on top of the $40 starting price, and multi-step agent runs consume events quickly; custom SSO, on-premise deployment and the listed compliance items sit on Enterprise.
Variable cost rationale
Event based metering scales with agent activity; multi step agent runs consume events quickly relative to headline quotas.
Additional watchouts
Verify live pricing directly with the vendor before budgeting; third party figures conflict and the primary page has been down.
Sales call required
Mixed (some tiers require a call)
Free / trial
Basic plan free up to 5,000 events; the platform can also be self-hosted
Lowest paid plan
Pro from $40 a month, pay as you go
Commercial notes
Framework-agnostic agent observability with native integrations for the major agent frameworks; the SDK is open source and the platform can be self-hosted, with a hosted service that is free to start.
Key ambiguities
agentops.ai/pricing returns not found; the prices are read from the pricing section of the homepage, which points to a pricing calculator for Pro usage that was not on the page.
Missing data
Current exact tier pricing and quotas; the primary pricing page is unreadable (404) as of mid 2026.
Related vendors
- Agno — Python agent framework and AgentOS runtime (formerly Phidata) for…
- AIsa — Resource and payment gateway for AI agents: one key to 110+ models…
- AlphaBitCore — AI control plane for regulated financial firms: one gateway enforces…
- Anchor Browser — Cloud hosted browser infrastructure that lets AI agents operate real…
- Apify — Cloud platform and marketplace of more than 73,000 ready-to-run…
- Arcade — Actions runtime for AI agents: delegated user authorization, 8,000+…
Alternatives to AgentOps
The closest documented capability profiles to AgentOps among agent infrastructure platforms tracked by Agentic Index, ordered by similarity on the same 14 point evidence the rankings use. No vendor pays for placement.
- Prefactor4.5 / 14Adds documented Human Oversight & Guardrails
- Patronus AI6.0 / 14Adds documented Triggers & Channel Coverage
- Voker6.0 / 14Adds documented Triggers & Channel CoverageAgentOps vs Voker →
- Arcade7.5 / 14Adds documented Human Oversight & Guardrails
- Clawvisor6.5 / 14Adds documented Human Oversight & Guardrails
- Coral5.5 / 14Adds documented Knowledge Grounding & RAG and Human Oversight & Guardrails
Similarity is computed from each vendor's Agentic Index coverage score evidence, axis by axis, not from the totals. How this evidence is graded