Haystack
Also known as: deepset, Haystack
Open source Python framework by deepset for agents, RAG and search pipelines, with the Haystack Enterprise Platform for managed or self-hosted deployment and governance.
Haystack is an open source Python framework from deepset for building production agents, retrieval-augmented generation and search applications, installed with pip and now in its 3.x line. Applications are pipelines of modular components connected into graphs with branches, loops and cycles; agents run tool-calling loops inside them, and multi-agent systems let a coordinator agent delegate to specialist agents. Tools can be built from any component, pipeline or Python function, or loaded from MCP servers.
Retrieval is Haystack's home ground: indexing pipelines write documents into stores such as Weaviate, Pinecone and Elasticsearch, and keyword, embedding and hybrid retrievers, rankers and metadata filters shape what reaches the model. A confirmation hook lets a person confirm, reject or modify an agent's tool calls, evaluators score whole pipelines or single components, and traces export to OpenTelemetry, Datadog, Langfuse and MLflow. Agent Pack ships pre-configured agents, including an advanced RAG agent and a deep research agent. Hayhooks serves pipelines over HTTP, and the framework works across model providers including OpenAI, Anthropic, Mistral and Hugging Face.
deepset sells the Haystack Enterprise Platform on top of the open source core: a visual builder with templates, side-by-side testing, one-click deployment to managed cloud or self-hosted infrastructure, and governance with RBAC, SSO, audit logs, run history and guardrails. deepset states the platform is SOC 2 Type II and ISO 27001 certified. Haystack Enterprise Starter adds private support and deployment blueprints for teams on the open source framework.
Vendor details
Canonical URL
https://haystack.deepset.ai/
Category
Agent infrastructure
Company status
independent
Use cases & customers
Target customers
Deployment options
In practice
You're building a search assistant over millions of documents and need precise control of the retrieval path. Haystack's typed pipelines let you compose hybrid retrieval, filtering, and reranking explicitly before anything reaches the model.
You want an agent whose every step is visible, not behind a high-level abstraction. Haystack exposes retrieval, tools, memory, and generation as inspectable components in a directed graph you wire together yourself.
You need to deploy the same LLM application across clouds and on-prem without rewrites. Haystack pipelines are serializable and vendor-agnostic, so you can swap models or infrastructure and run anywhere with logging and monitoring.
Sources & related URLs
Related / legacy domains
Agentic Index coverage score
12.0 / 14 capabilities · 86%
| Integrations & Tool Calling | Full |
|---|---|
|
Agents call tools built from any component, pipeline or Python function, MCP tools and toolsets, and ready-made tools such as GitHub file editing and issue commenting. SourceHaystack, docs.haystack.deepset.ai tools pagesread 2026-09-21 |
|
| Workflow Orchestration | Full |
|
Pipelines connect modular components into graphs with branches, loops and cycles, agents run tool-calling loops inside them, and multi-agent systems let a coordinator agent delegate to specialist agents, so deterministic steps and agent steps combine in one run. SourceHaystack, docs.haystack.deepset.ai concepts/agents/multi-agent-systems and haystack.deepset.airead 2026-09-21 |
|
| Knowledge Grounding & RAG | Full |
|
Indexing pipelines write the customer's documents into document stores such as Weaviate, Pinecone and Elasticsearch, queried by keyword, embedding and hybrid retrievers with rankers and metadata filters, and the Enterprise Platform adds data indexing in its builder, which is a maintained retrieval structure over the customer's knowledge. SourceHaystack, docs.haystack.deepset.ai retrievers and document stores, and deepset.ai/haystack-platformread 2026-09-21 |
|
| Human Oversight & Guardrails | Full |
|
A confirmation hook on the agent intercepts tool calls before execution so a person can confirm, reject or modify each one, with policies to always ask, ask once or never ask, and the Enterprise Platform adds guardrails and policy enforcement, so autonomy can differ between low and high risk actions. SourceHaystack, docs.haystack.deepset.ai pipeline-components/agents/human-in-the-loop and deepset.ai/haystack-platformread 2026-09-21 |
|
| Security, Identity & Governance | Full |
|
The Haystack Enterprise Platform documents role-based access control, single sign-on and audit logs, and deepset states it is SOC 2 Type II and ISO 27001 certified, GDPR and HIPAA compliant and CSA STAR Level 1. SourceHaystack, deepset.ai/haystack-platformread 2026-09-21 |
|
| Observability & Auditability | Full |
|
The Enterprise Platform keeps a unified run history of every query, answer and context, with traces, component-level error monitoring, usage reports and audit logs, and the open source framework exports traces to OpenTelemetry, Datadog, Langfuse, MLflow and a logging tracer. SourceHaystack, deepset.ai/haystack-platform and docs.haystack.deepset.ai development/tracingread 2026-09-21 |
|
| Memory & State Persistence | Partial |
|
Haystack's own memory is run state: a State container shares data across tool calls within an agent run, and pipeline breakpoints save snapshots to resume from. Long-term memory comes through memory stores backed by Mem0's cloud API and Cognee, products sold separately, and no memory layer of Haystack's own with a stated scope and lifetime is documented. SourceHaystack, docs.haystack.deepset.ai agents state, memory-stores and pipeline-breakpointsread 2026-09-21 |
|
| Deployment & Data Residency | Full |
|
The Enterprise Platform deploys to managed cloud or self-hosted on the customer's own infrastructure, described as sovereign and on-premises capable, and the open source framework ships deployment guides for Docker, Kubernetes and OpenShift. SourceHaystack, deepset.ai/haystack-platform and docs.haystack.deepset.ai development/deploymentread 2026-09-21 |
|
| Prebuilt Agents, Templates & Packs | Full |
|
Agent Pack is a collection of complex, pre-configured agents to run as they are, customize or copy as a blueprint, including an advanced RAG agent and a deep research agent, and the Enterprise Platform starts builds from pipeline and agent templates; each agent does its own job and stands alone without the other. SourceHaystack, docs.haystack.deepset.ai agents/agent-pack and deepset.ai/haystack-platformread 2026-09-21 |
|
| Triggers & Channel Coverage | Partial |
|
Pipelines and agents run when called: Hayhooks serves them through HTTP endpoints and the Enterprise Platform deploys them behind a REST API, so any outside system can be wired to start one, but every source is custom-wired rather than a built-in channel, and no schedule or event source that wakes an agent on its own is documented. SourceHaystack, docs.haystack.deepset.ai development/hayhooks and deepset.ai/haystack-platformread 2026-09-21 |
|
| Model Flexibility & Routing | Full |
|
The developer picks generators from integrations with OpenAI, Anthropic, Mistral, Hugging Face and others with no vendor lock-in, and deepset describes a customer swapping LLMs without breaking the production system, so model choice sits with the customer. SourceHaystack, haystack.deepset.ai and deepset.ai/haystack-platformread 2026-09-21 |
|
| APIs, SDKs & MCP Extensibility | Full |
|
Haystack is a documented Python SDK installed with pip, Hayhooks serves pipelines and agents through HTTP endpoints, and the Enterprise Platform exposes deployed pipelines through a REST API and exports them as Python or YAML, so outside callers drive the platform. SourceHaystack, docs.haystack.deepset.ai development/hayhooks, haystack.deepset.ai and deepset.ai/haystack-platformread 2026-09-21 |
|
| Testing, Debugging & Optimization | Full |
|
Haystack evaluates entire pipelines or single components such as retrievers and generators with statistical and model-based evaluators, including exact match, context relevance and document ranking metrics, and the Enterprise Platform compares prompts, retrieval strategies and agent workflows side by side before production. SourceHaystack, docs.haystack.deepset.ai optimization/evaluation and deepset.ai/haystack-platformread 2026-09-21 |
|
| Browser & Computer Use | Not documented |
|
Neither Haystack nor the Enterprise Platform documents browser, desktop or computer control: Haystack's full documentation text carries no browser automation, headless browser or computer use capability, and its ready-made tools are API and code-execution tools rather than interface control. SourceHaystack, docs.haystack.deepset.airead 2026-09-21 |
|
The Agentic Index coverage score grades every vendor Full, Partial or Not documented against the same 14 buyer facing capabilities, from public evidence only. Each capability links to how all vendors in the index score on it. How this evidence is graded
Recent platform changes
Hayhooks 2.0.0, the open source server that exposes Haystack pipelines and agents as REST, MCP and A2A endpoints, adds durable execution. A run is checkpointed and resumes on any replica after a crash or redeploy, with retries, cancellation and streaming that can reconnect, and it can pause to wait for human input.
Bears on: Workflow orchestration
View sourceHaystack 2.30.2 prevents Agent from exiting prematurely when an invalid tool call is discarded; the model can continue looping and recover.
Bears on: Agent capability
View sourceHaystack 2.30.1 lets AzureOpenAIChatGenerator accept Secret values for azure_endpoint and api_version, enabling environment-variable-based runtime switching.
Bears on: Deployment / data residency
View sourcePricing
OSS free; Enterprise flex-priced
hybrid
Included quota
Open source framework: free, self-hosted, community support. Haystack Enterprise Starter: private consulting and support, pipeline and deployment blueprints. Haystack Enterprise Platform: visual builder, templates, testing, managed or self-hosted deployment, RBAC, SSO, audit logs and run history; free trial, then custom pricing.
What is public
The Haystack framework is free and open source. deepset sells Haystack Enterprise Starter (support and blueprints) and the Haystack Enterprise Platform (visual builder, testing, managed or self-hosted deployment, governance), with a free platform trial; no dollar figures are published for either.
Billing mechanics
Dual-track: the Haystack framework is free OSS (you pay only your own infra + LLM/vector costs). Commercial revenue comes from (1) Enterprise Starter - a support/services + templates layer priced 'simply, based on the size of your organization'; and (2) the Enterprise Platform - priced around platform licensing + agent/application runtime + any expert services, custom-quoted for cloud, hybrid, VPC, on-prem, or air-gapped deployments. A free trial of the Enterprise Platform is available.
Cost watchouts
On OSS you still pay infra, LLM tokens, and vector-DB usage yourself; Enterprise Starter/Platform prices aren't publicly listed (org-size and runtime-based, quote-only); expert-services/consulting hours are an additional line; on-prem/air-gapped deployments carry higher setup overhead
Variable cost rationale
OSS spend is fully usage-based (your own infra + LLM/vector); Enterprise Platform adds a licensing + runtime model where agent/application runtime and expert services scale the bill, so cost grows with deployment scale and support depth
Additional watchouts
Code-first/Python framework - strong control but requires engineering skill (newcomers face a learning curve vs fully managed tools); commercial pricing is entirely quote-only; limited presence on B2B review sites; OSS 'free' still means you own infra + model costs
Overage / add-ons
OSS imposes no caps (cost = your infra + model/vector usage). Enterprise Starter scales by organization size; Enterprise Platform cost scales with platform licensing + agent/application runtime + expert-services hours; deployment environment (cloud/VPC/on-prem) affects the quote.
Sales call required
Mixed (some tiers require a call)
Free / trial
OSS free; Enterprise Platform free trial
Lowest paid plan
OSS free; Enterprise Support flex-priced
Commercial notes
deepset publishes the Haystack framework as open source and sells two commercial layers on it: Haystack Enterprise Starter for support and blueprints, and the Haystack Enterprise Platform for building, deploying and governing agents; deepset names the European Commission and Bosch as platform customers.
Key ambiguities
No public dollar figures for Enterprise Starter or Enterprise Platform - 'based on organization size' and runtime/services scope, quote-only; the Enterprise Platform was previously 'deepset Cloud' (naming/packaging evolved); limited third-party pricing data exists
Cancellation / refund
OSS is free (open-source license, no contract); Enterprise Starter is a paid support/services subscription sized to your org; Enterprise Platform is custom-contracted with a free trial; deployment can be managed cloud, VPC, on-prem, or air-gapped
Support SLA / resale
Community support for the open source framework; Haystack Enterprise Starter adds private consulting and support; the Enterprise Platform adds forward deployed engineers who build with the customer's team.
Missing data
Enterprise Starter and Enterprise Platform have no public list pricing (org-size + runtime + services based, quote-only). Seed 'OSS framework free; Enterprise Support flex-priced; Enterprise Platform free trial' is accurate - Enterprise Starter is sized by organization, and the Enterprise Platform is custom-priced with a free trial.
Related vendors
- AgentOps — Agent observability and debugging platform: open source SDKs trace…
- Agno — Python agent framework and AgentOS runtime (formerly Phidata) for…
- AIsa — Resource and payment gateway for AI agents: one key to 110+ models…
- AlphaBitCore — AI control plane for regulated financial firms: one gateway enforces…
- Anchor Browser — Cloud hosted browser infrastructure that lets AI agents operate real…
- Apify — Cloud platform and marketplace of more than 73,000 ready-to-run…
Alternatives to Haystack
The closest documented capability profiles to Haystack among agent infrastructure platforms tracked by Agentic Index, ordered by similarity on the same 14 point evidence the rankings use. No vendor pays for placement.
- Agno13.0 / 14Fuller documented coverage on Memory & State Persistence and Triggers & Channel Coverage
- LlamaIndex12.0 / 14Fuller documented coverage on Memory & State PersistenceHaystack vs LlamaIndex →
- Tray.ai13.0 / 14Fuller documented coverage on Memory & State Persistence and Triggers & Channel Coverage
- Kestra12.5 / 14Fuller documented coverage on Memory & State Persistence and Triggers & Channel Coverage
- LangChain11.5 / 14Fuller documented coverage on Memory & State PersistenceHaystack vs LangChain →
- Mastra14.0 / 14Adds documented Browser & Computer Use
Similarity is computed from each vendor's Agentic Index coverage score evidence, axis by axis, not from the totals. How this evidence is graded