Directory
LLM gateways
Reviewed resources in LLM gateways. 106 resources listed.
opencode-llm-proxy
github.comAn OpenCode plugin that runs a local HTTP gateway translating between the OpenAI, Anthropic and Gemini API formats and whatever LLM provider OpenCode has configured, including streaming and parallel tool calling, so other tools only need one local endpoint.
Antseed
antseed.comA peer-to-peer network where providers offer AI inference services and buyers discover them through a DHT and route requests through encrypted connections, with a router that scores providers on price, latency and reputation.
NoPII
github.comA reverse proxy for LLM APIs that detects personal data in outgoing requests, replaces it with deterministic tokens before it reaches the model provider, and restores the original values in the response.
IllusionAgent
github.comAn open-source AI agent platform that unifies a multi-provider LLM gateway, a bilingual command-line interface, a browser-based web interface and an extension system into one assistant for Windows, macOS and Linux.
Radicalbit AI Gateway
docs.ai-gateway.radicalbit.aiAn LLM proxy with guardrails, rate limiting, multi-strategy routing, semantic caching, an MCP proxy and end-to-end request tracing, configured through a UI that turns a plain-English description into YAML.
Oai2Ollama
oai2ollama.vercel.appA command-line tool that starts a local server exposing an Ollama-compatible API in front of any OpenAI-compatible API, for coding tools that only support Ollama as a custom model provider.
OllamaHub
github.comA local Windows proxy that imitates the Ollama API so Visual Studio Copilot Chat's bring-your-own-model feature can be pointed at OpenAI, Anthropic or Ollama-compatible providers instead.
cc-multi-cli-plugin
github.comA Claude Code plugin that brings other providers' models and coding tools, ChatGPT through Codex, Cursor, OpenCode Zen, Antigravity and Grok, into a single Claude Code session, each keeping its own login.
Maple
github.comA monorepo for Maple, a confidential AI research and chat application with a desktop Agent Mode, its client SDKs, a local OpenAI-compatible proxy, and the OpenSecret backend behind it.
ChatCLI
chatcli.edilsonfreitas.comA unified AI command-line and server platform that connects 14 LLM providers with failover, runs coordinated autonomous agents behind a ReAct engine, and also serves as a gRPC server and Kubernetes operator.
ocgo
github.comA small Go CLI that starts a local proxy so Claude Code and Codex CLI can run against an OpenCode Go subscription instead of their usual providers, in one command.
fastllm-proxy
fastllm.azrty.comA low-overhead LLM router written in Rust that fronts 80 providers and self-hosted vLLM or SGLang backends behind one OpenAI-compatible endpoint, reading existing LiteLLM-format configuration files unchanged.
ENZO
enzo-hub.duckdns.orgA self-hosted AI workspace that chats with more than 300 models across nine providers using your own API keys, with injectable agent skills and self-drafting agents, and no ENZO account or subscription.
hermes-router
hermes-router.vercel.appA router that sits between an app and a pool of AI providers such as Gemini, OpenRouter and Groq, trying the next provider automatically when one is rate-limited, behind one OpenAI- and Anthropic-compatible endpoint.
Earl
mathematic-inc.github.ioA secure CLI proxy that sits between AI agents and external APIs, running human-written HCL request templates so a model never sees the URL, auth header, or secret it is calling.
QuantClaw
sparkengineai.github.ioA plugin for the OpenClaw AI assistant that classifies each incoming request and routes it to a 4-bit, 8-bit or 16-bit precision model target, trading quality for latency and cost automatically instead of asking the user to choose.
VoidLLM
voidllm.aiA self-hosted, privacy-first LLM proxy and AI gateway sitting between applications and providers such as OpenAI, Anthropic or Ollama, adding access control, virtual API keys, usage tracking and load balancing, while never storing prompt content.
ollamaMQ
github.comA high-performance Rust proxy that queues requests from multiple users in front of one or more Ollama or LM Studio instances, dispatching them in parallel with a least-connections, round-robin, model-aware scheduler and a real-time terminal dashboard.
Gozar
github.comA self-hosted, Docker-first, OpenAI-compatible LLM gateway for local projects and private teams, giving every application one stable API endpoint and key while the gateway manages upstream provider accounts, credentials, two-lane fallback chains and usage limits.
KeiRouter
keirouter.appA self-hostable AI gateway written in Go that routes AI coding tools to one local endpoint, with automatic provider failover, semantic caching, budget limits and guardrails.
TiyGate
github.comA lightweight Rust gateway that unifies OpenAI-compatible, Anthropic Messages and Gemini protocols behind one control plane, with policy-based routing, failover and request logging across multiple LLM providers.
SmarterRouter
github.comA local, intelligent LLM gateway that profiles installed Ollama and llama.cpp models on your own hardware and automatically routes each request to whichever model performs best for it, as a drop-in OpenAI-compatible endpoint.
Dot Loom
app.usedot.xyzAn open, provider-pluggable runtime that decides how much inference an AI request needs, spending extra model calls on verification only for higher-risk work and reporting the policy, cost and latency for every run.
9Router Model Connector
github.comA VS Code extension and local proxy that switches the AI model behind GitHub Copilot Chat instantly from a web dashboard, without editing configuration files or reloading the editor.