AI model routing · updated 29 October 2026
Best AI model routers and LLM gateways (OpenRouter, LiteLLM, Portkey, Cloudflare, Not Diamond)
OpenRouter for model breadth and failover with nothing to run. LiteLLM to self-host routing logic you customise. Portkey for governance and guardrails over your own keys. Cloudflare AI Gateway for a free edge gateway if you are already on Cloudflare. Not Diamond for learned per-prompt routing on coding-agent fleets.
For: one key and one bill across 300+ models with automatic provider failover and nothing to run
Don't use if: your traffic is high-volume and predictable, credit fees and BYOK charges can exceed what self-hosting costs.