LLM gateways
Proxy, fallback and observability over your own provider keys.
12 providers
| Provider | Categories | Owner | Pricing at a glance |
|---|---|---|---|
| API7 AISIX AI Gateway (Apache APISIX lineage) | LLM gateways | API7.ai (private) | No token markup; BYOK only (pay providers directly). Developer $0 with 100k recorded requ… |
| Bifrost (Maxim AI) | LLM gateways | Maxim AI (private) | OSS (Apache 2.0), free to self-host, no token fees mentioned; enterprise pricing not publ… |
| Braintrust AI Gateway (AI proxy) | LLM gateways | Braintrust Data (private) | Gateway "free during beta", pricing TBA before GA. Platform: Starter $0/mo ($10 credits, … |
| Cloudflare AI Gateway | LLM gateways | Cloudflare, Inc. (NYSE:NET) | Core features (analytics, caching, rate limiting, DLP) free. Log storage: Free plan 100,0… |
| Gloo AI Gateway (Solo.io) | LLM gateways | Solo.io (private) | No published price: "Pricing at Solo depends on your environment and use case", contact s… |
| Helicone | LLM gateways | (private) | Hobby free (10,000 requests, 1 GB storage, 1 seat, 7-day retention); Pro $79/mo (10k requ… |
| Kong AI Gateway (Konnect) | LLM gateways | Kong Inc. (private) | Konnect Plus: charged per gateway per month; 1M API requests/mo included, then $200/mo pe… |
| LiteLLM (BerriAI) - OSS + Enterprise | LLM gateways | BerriAI (private) | OSS proxy free, self-hosted (you pay your own infra). Enterprise: "Pricing is based on us… |
| Portkey | LLM gateways | (private) | OSS self-hosted gateway free. Developer free: 10k recorded logs/mo (logs beyond the limit… |
| Respan (formerly Keywords AI) | LLM gateways | (private) | Free $0/mo (100k logs, 1k scores, 5 datasets, 2 evaluators, 5 prompts, 7-day retention); … |
| TrueFoundry AI Gateway | LLM gateways | TrueFoundry (private) | Developer $0 (up to 3 users, 10k requests/user); Pro $25/user/month (unlimited users, 20k… |
| Zuplo AI Gateway | LLM gateways | (private) | AI Gateway included on every plan, no token markup specified. Free 100k requests/mo; Buil… |