Directory

LLM gateways

Reviewed resources in LLM gateways. 106 resources listed.

106 listings in LLM gateways

  • An OpenCode plugin that runs a local HTTP gateway translating between the OpenAI, Anthropic and Gemini API formats and whatever LLM provider OpenCode has configured, including streaming and parallel tool calling, so other tools only need one local endpoint.

  • Antseed

    antseed.com

    A peer-to-peer network where providers offer AI inference services and buyers discover them through a DHT and route requests through encrypted connections, with a router that scores providers on price, latency and reputation.

  • NoPII

    github.com

    A reverse proxy for LLM APIs that detects personal data in outgoing requests, replaces it with deterministic tokens before it reaches the model provider, and restores the original values in the response.

  • IllusionAgent

    github.com

    An open-source AI agent platform that unifies a multi-provider LLM gateway, a bilingual command-line interface, a browser-based web interface and an extension system into one assistant for Windows, macOS and Linux.

  • Radicalbit AI Gateway

    docs.ai-gateway.radicalbit.ai

    An LLM proxy with guardrails, rate limiting, multi-strategy routing, semantic caching, an MCP proxy and end-to-end request tracing, configured through a UI that turns a plain-English description into YAML.

  • Oai2Ollama

    oai2ollama.vercel.app

    A command-line tool that starts a local server exposing an Ollama-compatible API in front of any OpenAI-compatible API, for coding tools that only support Ollama as a custom model provider.

  • OllamaHub

    github.com

    A local Windows proxy that imitates the Ollama API so Visual Studio Copilot Chat's bring-your-own-model feature can be pointed at OpenAI, Anthropic or Ollama-compatible providers instead.

  • A Claude Code plugin that brings other providers' models and coding tools, ChatGPT through Codex, Cursor, OpenCode Zen, Antigravity and Grok, into a single Claude Code session, each keeping its own login.

  • Maple

    github.com

    A monorepo for Maple, a confidential AI research and chat application with a desktop Agent Mode, its client SDKs, a local OpenAI-compatible proxy, and the OpenSecret backend behind it.

  • ChatCLI

    chatcli.edilsonfreitas.com

    A unified AI command-line and server platform that connects 14 LLM providers with failover, runs coordinated autonomous agents behind a ReAct engine, and also serves as a gRPC server and Kubernetes operator.

  • ocgo

    github.com

    A small Go CLI that starts a local proxy so Claude Code and Codex CLI can run against an OpenCode Go subscription instead of their usual providers, in one command.

  • fastllm-proxy

    fastllm.azrty.com

    A low-overhead LLM router written in Rust that fronts 80 providers and self-hosted vLLM or SGLang backends behind one OpenAI-compatible endpoint, reading existing LiteLLM-format configuration files unchanged.

  • ENZO

    enzo-hub.duckdns.org

    A self-hosted AI workspace that chats with more than 300 models across nine providers using your own API keys, with injectable agent skills and self-drafting agents, and no ENZO account or subscription.

  • hermes-router

    hermes-router.vercel.app

    A router that sits between an app and a pool of AI providers such as Gemini, OpenRouter and Groq, trying the next provider automatically when one is rate-limited, behind one OpenAI- and Anthropic-compatible endpoint.

  • Earl

    mathematic-inc.github.io

    A secure CLI proxy that sits between AI agents and external APIs, running human-written HCL request templates so a model never sees the URL, auth header, or secret it is calling.

  • QuantClaw

    sparkengineai.github.io

    A plugin for the OpenClaw AI assistant that classifies each incoming request and routes it to a 4-bit, 8-bit or 16-bit precision model target, trading quality for latency and cost automatically instead of asking the user to choose.

  • VoidLLM

    voidllm.ai

    A self-hosted, privacy-first LLM proxy and AI gateway sitting between applications and providers such as OpenAI, Anthropic or Ollama, adding access control, virtual API keys, usage tracking and load balancing, while never storing prompt content.

  • ollamaMQ

    github.com

    A high-performance Rust proxy that queues requests from multiple users in front of one or more Ollama or LM Studio instances, dispatching them in parallel with a least-connections, round-robin, model-aware scheduler and a real-time terminal dashboard.

  • Gozar

    github.com

    A self-hosted, Docker-first, OpenAI-compatible LLM gateway for local projects and private teams, giving every application one stable API endpoint and key while the gateway manages upstream provider accounts, credentials, two-lane fallback chains and usage limits.

  • KeiRouter

    keirouter.app

    A self-hostable AI gateway written in Go that routes AI coding tools to one local endpoint, with automatic provider failover, semantic caching, budget limits and guardrails.

  • TiyGate

    github.com

    A lightweight Rust gateway that unifies OpenAI-compatible, Anthropic Messages and Gemini protocols behind one control plane, with policy-based routing, failover and request logging across multiple LLM providers.

  • SmarterRouter

    github.com

    A local, intelligent LLM gateway that profiles installed Ollama and llama.cpp models on your own hardware and automatically routes each request to whichever model performs best for it, as a drop-in OpenAI-compatible endpoint.

  • Dot Loom

    app.usedot.xyz

    An open, provider-pluggable runtime that decides how much inference an AI request needs, spending extra model calls on verification only for higher-risk work and reporting the policy, cost and latency for every run.

  • A VS Code extension and local proxy that switches the AI model behind GitHub Copilot Chat instantly from a web dashboard, without editing configuration files or reloading the editor.