TrueFoundry

TrueFoundry provides an enterprise grade AI gateway that unifies access to more than 250 models from providers such as OpenAI, Anthropic, Google, Groq, and Mistral through a single OpenAI compatible API, with centralized key management, intelligent routing, failover, guardrails, rate limiting, observability, and flexible deployment. It sits directly in the production inference path as a control plane between applications and model providers, managing routing, governance, security, and cost without requiring changes to application logic. The company is independent, recognized in Gartner platform engineering research, and has expanded its control plane through the acquisition of Seldon AI.

The gateway enforces role based access control, single sign on, OAuth, and policy controls including PII and toxicity guardrails across all LLM traffic, and provides ClickHouse backed analytics for cost and usage breakdowns by model, team, user, or metadata. Reliability features include latency based and weighted routing, health based failover, semantic caching that can cut redundant calls, and support for both hosted and self hosted open source models such as Llama and Mistral through vLLM, SGLang, KServe, and Triton. Reported scale reaches billions of requests a month with multi region and high uptime targets.

A distinguishing capability for agentic use cases is a native MCP gateway. It exposes virtual MCP servers that aggregate tools like database queries, API calls, and file access behind one managed endpoint, injects OAuth identity so agents act as specific users with user level permissions on every tool call, and supports hybrid deployment where sensitive tools stay on premise while reasoning happens in the cloud. Deployment spans fully managed SaaS, customer cloud, VPC, on premise, and air gapped, with data residency controls. Pricing includes a free Developer tier for prototyping, a Pro tier from $499 a month for small teams shipping real features with usage based limits, and a sales led Enterprise tier for strict data controls and advanced governance, with a self hosted gateway plane running roughly $600 a month in cloud infrastructure.