AgentOps
Also known as: AgentOps.ai
Agent observability and debugging platform: open source SDKs trace LLM calls, tools and multi agent runs for step by step replay and cost tracking across 400+ models, with a public API, MCP server and self hosting.
AgentOps is a developer platform for tracing and debugging AI agents and LLM applications. After about two lines of code, its Python or TypeScript SDK records the LLM calls, tool calls and operations an agent makes as a trace of spans, and the dashboard replays each run step by step with point in time precision, visualizes multi agent interactions, and tracks tokens and cost across more than 400 models. It keeps a data trail of logs, errors and prompt injection attempts, integrates natively with agent frameworks such as AG2, Agno, CrewAI, the OpenAI Agents SDK, LangChain and LlamaIndex, and exposes trace data through a read only public API and an MCP server.
The platform can be self hosted, with the API server, dashboard and data layers running on the customer's own servers or cloud through Docker Compose, Kubernetes or AWS, GCP and Azure. The hosted service is free up to 5,000 events, Pro starts at $40 a month on a pay as you go basis with unlimited events, log retention, export and role based permissions, and Enterprise adds custom SSO, on premise deployment and custom retention. AgentOps also offers fine tuning of specialized models on saved completions and expert help building agents.
Vendor details
Canonical URL
https://www.agentops.ai
Category
Agent infrastructure
Subcategory
Agent observability & evaluation
Funding status
Seed-stage; ~$2.6M raised (2024) under parent company Agency (Staf.ai).
Company status
independent
Use cases & customers
Primary use cases
Target customers
Deployment options
Integrations
Python and TypeScript SDK that instruments agents in about two lines of code. Native integrations with CrewAI, AutoGen/AG2, the OpenAI Agents SDK, LangChain, LlamaIndex, Agno and Google ADK, plus cost and usage tracking across 400+ LLMs. Traces are recorded as spans, and the self hosted platform includes an OpenTelemetry collector.
In practice
An agent run goes wrong in production and you have no idea which step broke. AgentOps records every LLM call, tool call and operation as a trace you can replay step by step.
Your agent stack spans several frameworks and none of them monitor the others. AgentOps integrates natively with CrewAI, AutoGen, LangChain, LlamaIndex, and the OpenAI Agents SDK, so one tool covers them all.
Token spend creeps up and you can't see where. AgentOps tracks tokens and cost across more than 400 models, so the bill isn't a mystery.
Sources & related URLs
Related / legacy domains
Agentic Index coverage score
5.0 / 14 capabilities · 36%
| Integrations & Tool Calling | Partial |
|---|---|
|
The major agent frameworks and providers are instrumented natively, including AG2, Agno, CrewAI, the OpenAI Agents SDK, LangChain and LlamaIndex, and AgentOps traces the tool calls those agents make. These integrations bring trace data in, and none connects an agent to a real system to take actions. SourceAgentOps, docs.agentops.ai/llms.txt (integrations) and agentops.ai homepageread 2026-09-21 |
|
| Workflow Orchestration | Not documented |
|
Multi agent workflows the customer runs are visualized from their traces, with operations tied to named agents. AgentOps does not run workflows of its own, and nothing in it sequences, branches or retries steps or combines deterministic nodes with agent steps. SourceAgentOps, docs.agentops.ai/llms.txt (tracking agents, recording operations) and agentops.ai homepageread 2026-09-21 |
|
| Knowledge Grounding & RAG | Not documented |
|
Calls a customer's agents make are traced, including retrieval steps where the customer instruments them. AgentOps names no document ingestion, index, retrieval layer or knowledge API that grounds an agent in company data. SourceAgentOps, docs.agentops.ai/llms.txtread 2026-09-21 |
|
| Human Oversight & Guardrails | Not documented |
|
Logs, errors and prompt injection attacks leave a data trail, and runs can be replayed for review. AgentOps names no approval step, consent checkpoint, runtime guardrail or pause and resume control over an agent's actions. SourceAgentOps, agentops.ai homepage and docs.agentops.ai/llms.txtread 2026-09-21 |
|
| Security, Identity & Governance | Partial |
|
The Pro plan adds role based permissioning, and the Enterprise plan adds custom SSO, a custom data retention policy and on premise or self hosted deployment. Self hosting lets a customer apply its own security policies. The plans mention compliance standards, with no published report or auditor behind them. SourceAgentOps, agentops.ai homepage pricing section and docs.agentops.ai/v2/self-hosting/overviewread 2026-09-21 |
|
| Observability & Auditability | Full |
|
Each agent run is recorded as a trace of spans for LLM calls, tool calls, operations and named agents, with the host environment captured automatically. The dashboard replays runs step by step with point in time precision, visualizes multi agent interactions and tracks tokens and cost. The Pro plan adds session and event export and unlimited log retention. A read only public API and an MCP server expose trace and span data. SourceAgentOps, docs.agentops.ai/llms.txt (traces, spans, host environment, public API, MCP server) and agentops.ai homepageread 2026-09-21 |
|
| Memory & State Persistence | Not documented |
|
Traces, sessions and completions are stored as records of the customer's agent runs. AgentOps names no session, workflow or long term memory that an agent reads and writes. SourceAgentOps, docs.agentops.ai/llms.txt (traces, core concepts)read 2026-09-21 |
|
| Deployment & Data Residency | Full |
|
Customers can use the hosted service or self host the whole platform (API server, dashboard, Supabase and ClickHouse data layers and an OpenTelemetry collector) on their own servers or cloud through Docker Compose, Kubernetes or deployment to AWS, GCP and Azure, so data stays on their own infrastructure. The Enterprise plan adds on premise deployment, self hosting on AWS, GCP and Azure, and a custom data retention policy. SourceAgentOps, docs.agentops.ai/v2/self-hosting/overview and agentops.ai homepage; docs.agentops.ai/v2/self-hosting/overview.mdread 2026-09-21 |
|
| Prebuilt Agents, Templates & Packs | Not documented |
|
Examples show how to instrument agents built with various frameworks, and AgentOps offers expert help building agents as a service. It names no ready made agents, templates or packaged workflows for customers to adopt. SourceAgentOps, agentops.ai homepage and docs.agentops.ai/llms.txt (examples)read 2026-09-21 |
|
| Triggers & Channel Coverage | Not documented |
|
When the customer's instrumented code runs, traces arrive and appear in the dashboard. AgentOps names no schedule, event trigger, alert or automation that starts work on its own. SourceAgentOps, docs.agentops.ai/llms.txt and agentops.ai homepageread 2026-09-21 |
|
| Model Flexibility & Routing | Partial |
|
More than 400 LLMs and frameworks that a customer's agents call can be traced and costed, and tracing does not constrain which model the agent uses. Customers do not choose, route or key any model the product itself runs, and AgentOps names no model policy. SourceAgentOps, agentops.ai homepage and docs.agentops.ai/llms.txt (tracking LLM calls)read 2026-09-21 |
|
| APIs, SDKs & MCP Extensibility | Full |
|
AgentOps publishes open source Python and TypeScript SDKs with decorators, context managers and manual trace control, a read only HTTP public API for trace and span data, and an MCP server that exposes trace and span data to MCP clients, alongside an MCP docs server. SourceAgentOps, docs.agentops.ai/llms.txt (SDK reference, TypeScript SDK, public API, MCP server)read 2026-09-21 |
|
| Testing, Debugging & Optimization | Partial |
|
Teams debug agents by rewinding and replaying runs with point in time precision, and a data trail of errors and prompt injection attempts is kept. AgentOps also offers fine tuning of specialized models on saved completions as an optimization step after deployment. It names no testing against fixtures or datasets, configurable quality gates or scoring of output quality over time. SourceAgentOps, agentops.ai homepage and docs.agentops.ai/llms.txtread 2026-09-21 |
|
| Browser & Computer Use | Not documented |
|
The product covers SDK instrumentation, tracing, the dashboard, a public API, an MCP server and self hosting. AgentOps names no browser, desktop or computer control by an agent. SourceAgentOps, docs.agentops.ai/llms.txtread 2026-09-21 |
|
The Agentic Index coverage score grades every vendor Full, Partial or Not documented against the same 14 buyer facing capabilities, from public evidence only. Each capability links to how all vendors in the index score on it. How this evidence is graded
Pricing
Free up to 5,000 events · Pro from $40/mo · Enterprise custom
usage
Included quota
Free tier is event capped; an event is each tracked LLM call, tool call, or action, so a single agent run can emit a dozen or more events and the free tier suits evaluation rather than production. Compliance (SOC 2, HIPAA, NIST AI RMF), self hosting, and SSO are Enterprise gated.
What is public
A free tier, a self serve paid tier, and a custom Enterprise tier are consistently confirmed across sources, as is the MIT licensed open source SDK and app. Exact current tier numbers are not reliably public.
Billing mechanics
Event metered freemium: tracked events deduct from plan quotas, with Enterprise handling compliance, self hosting, and SLAs.
Cost watchouts
Pro is pay as you go on top of the $40 starting price, and multi-step agent runs consume events quickly; custom SSO, on-premise deployment and the listed compliance items sit on Enterprise.
Variable cost rationale
Event based metering scales with agent activity; multi step agent runs consume events quickly relative to headline quotas.
Additional watchouts
Verify live pricing directly with the vendor before budgeting; third party figures conflict and the primary page has been down.
Sales call required
Mixed (some tiers require a call)
Free / trial
Basic plan free up to 5,000 events; the platform can also be self-hosted
Lowest paid plan
Pro from $40 a month, pay as you go
Commercial notes
Framework-agnostic agent observability with native integrations for the major agent frameworks; the SDK is open source and the platform can be self-hosted, with a hosted service that is free to start.
Key ambiguities
agentops.ai/pricing returns not found; the prices are read from the pricing section of the homepage, which points to a pricing calculator for Pro usage that was not on the page.
Missing data
Current exact tier pricing and quotas; the primary pricing page is unreadable (404) as of mid 2026.
Related vendors
- AgentPhone — AgentPhone gives the AI agents a team builds their own US or…
- Agno — Python agent framework and AgentOS runtime (formerly Phidata) for…
- AIsa — Resource and payment gateway for AI agents, with one key to 110+…
- Albato — Albato is a no code integration platform that sells an embedded,…
- AlphaBitCore — AI control plane for regulated financial firms: one gateway enforces…
- Anchor Browser — Cloud hosted browser infrastructure that lets AI agents operate real…
Alternatives to AgentOps
The closest documented capability profiles to AgentOps among agent infrastructure platforms tracked by Agentic Index, ordered by similarity on the same 14 point evidence the rankings use. No vendor pays for placement.
- Prefactor4.5 / 14Adds documented Human Oversight & Guardrails
- Voker6.0 / 14Adds documented Triggers & Channel CoverageAgentOps vs Voker →
- Arcade7.5 / 14Adds documented Human Oversight & Guardrails
- Clawvisor6.5 / 14Adds documented Human Oversight & Guardrails
- Coral5.5 / 14Adds documented Knowledge Grounding & RAG and Human Oversight & Guardrails
- Portkey7.5 / 14Adds documented Human Oversight & Guardrails
Similarity is computed from each vendor's Agentic Index coverage score evidence, axis by axis, not from the totals. How this evidence is graded