Freeplay

Tool schemas are versioned inside prompt templates, and Freeplay records the tool calls a customer's agent makes, integrates with LangGraph, the Vercel AI SDK, Google ADK and OpenTelemetry to capture traces, and posts automation alerts to Slack. The customer's own code executes every tool call; no connector that lets an agent read or write a real system through Freeplay is documented.

SourceFreeplay, docs.freeplay.ai tool calls, AI framework integrations, saved searches and automationsread 2026-09-21

Whatever way the customer manages orchestration, Freeplay observes, evaluates and tests agents built elsewhere and records multi-prompt chains as traces. No sequencing, branching, retries or routing of agent steps run by Freeplay is documented.

SourceFreeplay, docs.freeplay.ai agents in Freeplay, multi-prompt chain reciperead 2026-09-21

Retrieved context that a customer's application passes to a prompt is logged, and RAG pipelines can be tested end to end. No document ingestion, index, retrieval layer or knowledge API that grounds an agent in company data is documented.

SourceFreeplay, docs.freeplay.ai end-to-end test runs and llms.txtread 2026-09-21

Review queues assign production completions and traces to named reviewers for human evaluation, and automations route guardrailed or low-scoring responses into those queues so a person reviews them. Review happens after an output is produced; no approval step, checkpoint or pause that holds an agent's action for a person is documented.

SourceFreeplay, docs.freeplay.ai review queues, saved searches and automationsread 2026-09-21

SOC 2 Type II certification is stated as achieved, with details on Freeplay's trust center, and HIPAA Business Associate Agreements are offered; customers get SAML single sign-on through WorkOS with Okta, Microsoft Entra ID, Cisco Duo, OneLogin and JumpCloud, SCIM provisioning and deprovisioning, four account roles with project-level role overrides, mandatory multi-factor authentication, revocable API keys, and a configurable retention window on Enterprise.

SourceFreeplay, docs.freeplay.ai security overview, single sign-on and SCIM, user roles and access controls, data retentionread 2026-09-21

Every LLM call is recorded as a completion tied to its prompt template version, and Freeplay groups completions into traces for agent flows and into sessions for whole interactions, records tool calls, and lets teams search and filter production logs by inputs, outputs, evaluation scores, metadata, cost and latency; it ingests OpenTelemetry traces, exports traces to CSV and exposes search endpoints for sessions, traces and completions. Logged data is kept 90 days by default and the window is configurable on Enterprise plans.

SourceFreeplay, docs.freeplay.ai sessions, traces and completions, automations and filters, data retentionread 2026-09-21

Sessions, traces, datasets and prompt versions are stored for observability and testing, and Freeplay's multi-turn chat guide leaves conversation history to the customer's application. No session, workflow or long term memory that an agent reads and writes through Freeplay is documented.

SourceFreeplay, docs.freeplay.ai llms.txt and managing multi-turn chat history reciperead 2026-09-21

Besides the multi-tenant cloud service, Enterprise customers can run Freeplay as Bring-Your-Own-Cloud inside their own AWS, GCP or Azure account, where all prompts and responses stay in the customer's cloud and Freeplay never receives them, installed through Replicated KOTS or Helm; single-tenant private hosting over a site-to-site VPN is also offered.

SourceFreeplay, docs.freeplay.ai private deployment (BYOC) and security overviewread 2026-09-21

Freeplay provides evaluator types, an eval creation assistant, code recipes and skills for coding agents that integrate with Freeplay. No ready-made agents, templates or packaged workflows a buyer adopts for its own work are documented.

SourceFreeplay, docs.freeplay.ai llms.txt, code recipes overview and developer resourcesread 2026-09-21

Automations run in the background, monitor production traffic continuously and act when logs match a saved search: they run evaluations, route completions to a review queue, add them to a dataset or post a Slack notification. Evaluation Insights runs a weekly AI analysis of production evaluation data. So work starts on an incoming log or on a schedule without a person asking.

SourceFreeplay, docs.freeplay.ai saved searches and automations, evaluation insightsread 2026-09-21

OpenAI, Anthropic, Azure OpenAI, Amazon Bedrock, SageMaker, Groq, Baseten and more are supported with the customer's own keys. Admins can disable default models and add their own models and endpoints to control which models the team may use and deploy, any model called through the SDKs is recorded, a LiteLLM proxy works as a custom provider, and Freeplay documents how to configure, test and deploy a fallback provider.

SourceFreeplay, docs.freeplay.ai model management, LiteLLM proxy, fallback provider guideread 2026-09-21

Freeplay publishes a REST API with an OpenAPI 3.1 specification covering observability, search, prompt templates, datasets, evaluation criteria, test runs and configuration, open source Python and Node SDKs under Apache-2.0 plus a Java and Kotlin SDK, an MCP server with skills and a Claude Code plugin for coding agents, and a CLI that bundles production prompts for a GitHub Actions check.

SourceFreeplay, docs.freeplay.ai developer resources overview, API introduction and llms.txtread 2026-09-21

Model-graded, code and human-labeled evaluations are all supported, and Freeplay runs batch test runs against datasets at the component level and end to end through a customer's full agent, including tool use, retrieval and multi-step workflows, starts test runs from the SDK or the API, aligns LLM judges with human labels, and runs online evaluations on sampled production logs. Test runs return scored results that can be compared across versions.

SourceFreeplay, docs.freeplay.ai evaluations overview, component and end-to-end test runs, aligning LLM judgesread 2026-09-21

Freeplay documents observability, prompt management, evaluations, test runs and human review for AI applications, and no browser, desktop or computer control by an agent is documented.

SourceFreeplay, docs.freeplay.ai llms.txtread 2026-09-21