LLM gateways

An open-source, self-healing LLM gateway that connects agents and apps to 300+ models through one OpenAI-compatible endpoint, with automatic fallback on failed requests.

• LLM gateways

A high-performance AI gateway unifying access to 23+ model providers behind one OpenAI-compatible API, with automatic failover, load balancing and semantic caching.

• LLM gateways

A single control-plane process that deploys, routes, secures and observes A2A-speaking AI agents behind one gateway, with an LLM router that never exposes a real API key to an agent.

• Agent frameworks
• LLM gateways

An open-source, cloud-native API and AI gateway supporting REST, GraphQL, TCP, gRPC and MCP traffic, with rate limiting, authentication, analytics and per-tool access control for AI agents.

• LLM gateways
• APIs

A lightweight, open-source gateway that routes requests to more than 1,600 language, vision, audio and image models through one API, with automatic retries, load balancing, guardrails and an MCP gateway.

• LLM gateways

A local proxy that lets OpenAI Codex, Claude Code, Claude Desktop and Grok Build run any large language model provider, translating between Codex's API format and more than 40 built-in providers or any OpenAI-compatible endpoint.

• LLM gateways

A local gateway that gives coding agents such as Claude Code, Codex and others one stable endpoint, while letting a developer manage providers, models, routing rules and fallbacks from a single place.

• LLM gateways

Kong Gateway is a cloud-native, platform-agnostic API gateway that also governs LLM and MCP traffic, adding multi-provider AI routing, semantic security and MCP traffic analytics on top of its core proxying and plugin system.

• LLM gateways
• APIs

New API is a self-hosted AI gateway that lets a team connect upstream model services once and expose a consistent, cross-converted OpenAI-, Claude- or Gemini-compatible API to its own clients and agents.

• LLM gateways

LiteLLM is a Rust-core, Python-SDK gateway that gives one OpenAI-format interface to more than a hundred LLM providers, with cost tracking, guardrails, load balancing and logging.

• LLM gateways