LLM Gateway alternatives and competitors
- Category
- Agent infrastructure platforms
- LLM Gateway price
- Free to start; tokens at provider rates plus a 5% fee on prepaid credits; own keys and self hosting free; DevPass from $29 a month; Enterprise custom
- Alternatives listed
- 7
LLM Gateway is an open source, OpenAI compatible gateway that sends the model calls of a team's agents and apps to more than 250 models across over 40 providers through one key. It charges provider token rates plus a flat 5% fee on prepaid credits, and it is free on the customer's own keys or self hosted under AGPLv3.
The alternatives below also route model calls through one gateway. They differ in whether they are self hosted or managed, whether they charge a platform fee on tokens, by logged requests, by seat or by model, and how much observability and governance they add.
7 alternatives to LLM Gateway
-
L
LiteLLM
Open source gateway with an enterprise license
LiteLLM puts more than 140 model providers behind one OpenAI compatible API, with keys, budgets and routing. The MIT licensed core is free to self host, and Enterprise is an annual license quoted by request capacity.
Starting price Open source core free to self host; Enterprise annual license by quote
-
O
OpenRouter
Managed model marketplace
OpenRouter routes to more than 500 models from over 80 providers through one endpoint, with failover and spend controls. It charges provider rates plus a 5.5% platform fee, with a free tier of 25 free models.
Starting price Pay as you go at provider rates plus a 5.5% platform fee (8% on Business). A free tier is available.
-
P
Portkey
Gateway with guardrails and logging
Portkey routes to many model providers with caching and guardrails, adds MCP and agent gateways and logs every request and tool call. The open source gateway is free to self host, a Developer plan is free, and Production costs $49 a month.
Starting price Free Developer plan · Production $49/mo · open source gateway free to self host
-
T
TrueFoundry
Enterprise gateway for models, MCP and agents
TrueFoundry runs an AI gateway for LLMs, MCP servers and agents as SaaS, in a VPC, on premises or air gapped. Developer is free for up to three users, and Pro costs $25 per user a month.
Starting price Developer free, Pro $25 per user a month plus traffic
-
H
Helicone
Observability first gateway
Helicone logs, routes, caches and costs every request through one OpenAI compatible endpoint, and it is open source and self hostable. Hobby is free, Pro costs $79 a month and Team $799.
Starting price Free Hobby; Pro $79 a month; Team $799; open source
-
K
Kong
API gateway extended to AI traffic
Kong AI Gateway governs model, MCP and agent to agent calls from one control plane, with guardrails and regional hosting. Plus starts at $25 a month plus usage, with the AI Gateway at $100 a month per model proxied.
Starting price Plus from $25 a month plus usage, with the AI Gateway at $100 a month per model; Enterprise custom
-
S
Stacklok
Self hosted tool and AI gateway
Stacklok runs MCP servers in isolated containers behind an identity aware tool gateway, with an AI gateway for model routing, budgets and audit on Kubernetes. ToolHive Community is free and open source, and Enterprise is an annual subscription by quote.
Starting price ToolHive Community free and open source; Stacklok Enterprise by quote, as an annual subscription
LLM Gateway alternatives, answered
What are the best alternatives to LLM Gateway?
LiteLLM and Portkey are the closest matches for teams that want an open source gateway with a commercial tier. OpenRouter suits teams that want a managed marketplace with a platform fee, as LLM Gateway's hosted service charges. TrueFoundry, Kong and Stacklok suit enterprises that want one control plane for models, tools and agents, and Helicone suits teams that lead with observability.
Who are LLM Gateway's competitors?
LLM Gateway competes with LiteLLM, Portkey and Helicone among open source gateways, with OpenRouter in managed model routing, and with TrueFoundry, Kong and Stacklok in enterprise AI and tool gateways.
How is LLM Gateway priced against its alternatives?
LLM Gateway adds a 5% fee to provider rates on prepaid credits, and nothing on the customer's own keys. OpenRouter adds 5.5%. LiteLLM's core is free with Enterprise by quote, Portkey Production costs $49 a month, Helicone Pro $79, TrueFoundry Pro $25 per user and Kong's AI Gateway $100 a month per model, while Stacklok Enterprise is quoted.
Which LLM Gateway alternatives can be self hosted?
LiteLLM, Portkey's open source gateway, Helicone and Stacklok's ToolHive can all be self hosted, and TrueFoundry deploys in a VPC, on premises or air gapped.