Portkey
Open-source AI gateway: route across 200+ providers with fallbacks, caching, and guardrails.
About
Portkey's AI Gateway (portkey-ai/gateway, MIT, ~13k stars) is a self-hosted proxy that sits in front of 200+ LLM providers: unified API, automatic fallbacks and retries, semantic caching, rate limiting, and guardrails — run it with npx @portkey-ai/gateway. The managed Portkey platform adds observability and prompt management on top.
Notable: Gateway 2.0 (pre-release) merges Portkey's enterprise gateway core into the open-source repo. Cadence note: last stable push was May 2026 — slower than peers, but not archived.
What it can do
- Unified API across 200+ LLM providers
- Automatic fallbacks, retries, load balancing
- Semantic and exact-match caching
- Guardrails and rate limiting
- Self-hosted, MIT-licensed
Setup
- Run the gateway:
npx @portkey-ai/gateway(or Docker). - Configure provider API keys in
portkey-config.json. - Point your OpenAI-compatible client at the gateway URL.
- Add fallbacks, caching, and guardrails in the config.
Prerequisites
Node.js 18+ or Docker; provider API keys.
Use cases
Works with
Trust score — 8/10
Scored 8/10 (verified tier). Genuinely open-source MIT gateway with ~13k stars, install command verified in the README, and the 2.0 enterprise-merge is a strong openness signal. Docked for the slower release cadence (last push May 2026) — worth watching, but the repo is not archived. Verified tier.
★ 13,172 GitHub stars
How the trust score is built
Full methodology →- Adoption · stars/downloads, log-scaled vs peers
- 7.8/10
- Maintenance · recency, releases, issue load
- 6.5/10
- Openness · license + docs
- 9.4/10
- Manual review · sanity read + red-flag check
- 8.0/10
- · 13,172 GitHub stars (log-scaled vs catalog peers)
- · last push 141d ago; 8 releases/12mo; 294 open issues
- · manual review: open-source AI gateway; last push May 2026 — slower cadence, not archived; 200+ provider routing; license: MIT
Sources
Every fact above was checked against these sources. Where a claim comes from the provider and couldn't be independently verified, the text says so.