Portkey
CategoryManaged AI gateway
PricingFree tier; paid from ~$49/mo
Verdict
Managed gateway with the strongest built-in semantic caching, plus guardrails, routing, and cost analytics. The low-ops route to the same control points LiteLLM gives you self-hosted.
Strengths
- Semantic + simple caching out of the box
- Config-driven routing, retries, fallbacks without code changes
- Good cost dashboards with per-metadata breakdowns
Limitations
- Your traffic transits a third party (self-hosted enterprise option exists)
- Costs money at scale — model the gateway fee against the savings