L

LiteLLM alternatives and competitors

LiteLLM price
Open source core free to self host; Enterprise annual license by quote
Alternatives listed
7

LiteLLM is an open source AI gateway and Python SDK that puts more than 140 model providers behind one OpenAI compatible API, with MCP and agent gateways, keys, budgets, routing and self hosting. The MIT licensed core is free to self host, and Enterprise is an annual license quoted by request capacity, never per token.

The alternatives below also route model calls through one gateway. They differ in whether they are self hosted or managed, whether they charge a platform fee on tokens, by logged requests, by seat or by model, and how much observability and governance they add.

7 alternatives to LiteLLM

  1. P

    Portkey

    Gateway with guardrails and logging

    Portkey routes to many model providers with caching and guardrails, adds MCP and agent gateways and logs every request and tool call. The open source gateway is free to self host, a Developer plan is free, and Production costs $49 a month.

    Starting price Free Developer plan · Production $49/mo · open source gateway free to self host

  2. O

    OpenRouter

    Managed model marketplace

    OpenRouter routes to more than 500 models from over 80 providers through one endpoint, with failover and spend controls. It charges provider rates plus a 5.5% platform fee, with a free tier of 25 free models.

    Starting price Pay as you go at provider rates plus a 5.5% platform fee (8% on Business). A free tier is available.

  3. L

    LLM Gateway

    Open source gateway with a managed option

    LLM Gateway routes model calls with provider failover, guardrails, budgets and usage analytics, free to self host under AGPLv3. The hosted service charges a flat 5% platform fee on prepaid credits, and nothing when customers bring their own keys.

    Starting price Free to start; tokens at provider rates plus a 5% fee on prepaid credits; own keys and self hosting free; DevPass from $29 a month; Enterprise custom

  4. T

    TrueFoundry

    Enterprise gateway for models, MCP and agents

    TrueFoundry runs an AI gateway for LLMs, MCP servers and agents as SaaS, in a VPC, on premises or air gapped. Developer is free for up to three users, and Pro costs $25 per user a month.

    Starting price Developer free, Pro $25 per user a month plus traffic

  5. H

    Helicone

    Observability first gateway

    Helicone logs, routes, caches and costs every request through one OpenAI compatible endpoint, and it is open source and self hostable. Hobby is free, Pro costs $79 a month and Team $799.

    Starting price Free Hobby; Pro $79 a month; Team $799; open source

  6. K

    Kong

    API gateway extended to AI traffic

    Kong AI Gateway governs model, MCP and agent to agent calls from one control plane, with guardrails and regional hosting. Plus starts at $25 a month plus usage, with the AI Gateway at $100 a month per model proxied.

    Starting price Plus from $25 a month plus usage, with the AI Gateway at $100 a month per model; Enterprise custom

  7. n

    nexos.ai

    Gateway plus a governed AI workspace

    nexos.ai pairs a Gateway API with an employee workspace of more than 200 models under one set of admin controls. Self serve plans are billed per seat, monthly or for 12 months, and Enterprise is custom.

    Starting price One month and 12 month self serve plans billed per seat; Enterprise is custom through sales; Gateway pay as you go at provider prices plus 5%

LiteLLM alternatives, answered

What are the best alternatives to LiteLLM?

Portkey and LLM Gateway are the closest matches for teams that want an open source gateway with a managed option. OpenRouter suits teams that want a managed marketplace with no infrastructure to run. TrueFoundry and Kong suit enterprises that want one control plane for models, MCP and agents, Helicone suits teams that lead with observability, and nexos.ai suits companies that also want an employee AI workspace.

Who are LiteLLM's competitors?

LiteLLM competes with Portkey, LLM Gateway and Helicone among open source gateways, with OpenRouter in managed model routing, with TrueFoundry and Kong in enterprise AI gateways, and with nexos.ai in governed AI platforms.

How is LiteLLM priced against its alternatives?

LiteLLM's core is free to self host and Enterprise is an annual license by quote. OpenRouter adds a 5.5% fee to provider rates and LLM Gateway a 5% fee on prepaid credits. Portkey's Production plan costs $49 a month, Helicone Pro $79, TrueFoundry Pro $25 per user and Kong's AI Gateway $100 a month per model. nexos.ai bills per seat.

Which LiteLLM alternatives can be self hosted?

Portkey's open source gateway, Helicone and LLM Gateway can all be self hosted, and TrueFoundry deploys in a VPC, on premises or air gapped.

Contact us

Found a vendor we missed? Have feedback on the index? We'd love to hear from you.