LLM gateways

A Python toolkit giving a single OpenAI-compatible interface across Chinese large language models, so frameworks such as LangChain and LlamaIndex can call them without model-specific adapter code.

• LLM gateways

A VS Code extension that plugs a third-party model gateway into GitHub Copilot Chat's model picker, adding dozens of additional language models through a user-supplied key instead of a separate chat interface.

• LLM gateways
• Editors

An open-source, wire-first SDK that standardizes LLM, embedding, vector and graph infrastructure behind one protocol, so an application can swap providers without rewriting integration code across LangChain, LlamaIndex, AutoGen, CrewAI or MCP.

• LLM gateways

A terminal AI coding assistant compatible with Claude Code's configuration and skills, built to switch between multiple LLM providers within one session through its own router integration.

• Coding agents
• LLM gateways

A tool that networks computers a user already owns into a single OpenAI-compatible endpoint, routing each inference or training request to whichever machine runs the right model, with no account or relay required.

• Inference
• LLM gateways

A self-hosted AI gateway and application backend that an AI agent can operate end to end through MCP: routing model traffic, defining data models that become database tables and CRUD APIs, and assembling React frontend blocks.

• LLM gateways
• Backend

A Rust-native, stateful API gateway that sits in front of vLLM and implements an OpenAI-compatible Responses API server-side, so a client makes one call and the server manages conversation state, tool execution and streaming.

• LLM gateways

A lightweight proxy and load balancer for self-hosted LLM infrastructure, routing requests across local and remote inference backends with automatic failover and a unified model catalogue.

• LLM gateways

A self-hosted AI gateway that connects files, databases, APIs and MCP tools to local or hosted models behind one OpenAI-compatible API, with authentication, observability and an admin UI.

• RAG
• LLM gateways

A Rust library and command-line tool that lets an application call OpenAI, Anthropic, Ollama, DeepSeek, Google, Cohere, Mistral, Hugging Face, ElevenLabs and other LLM backends through one unified, builder-style API.

• LLM gateways

A macOS menu-bar app that routes the Claude Science desktop client to a third-party model API, such as DeepSeek, Qwen, GLM, Kimi, MiniMax or any OpenAI- or Anthropic-compatible endpoint, and can switch back to the official Claude account at any time.

• LLM gateways
• Desktop utilities

A self-hosted proxy that exposes OpenAI- and Anthropic-compatible endpoints backed by multiple LLM providers, with automatic API key rotation, failover and rate-limit handling.

• LLM gateways

An LLM gateway and CLI proxy that compresses tool outputs, caches semantically similar requests, and routes each request across more than a dozen providers by complexity, including wrapping an existing Claude Code or Codex subscription.

• LLM gateways

mimo2codex is a local proxy that lets the latest OpenAI Codex CLI or desktop app talk to other large language models, with built-in support for Xiaomi MiMo and DeepSeek and a generic mechanism for any OpenAI-compatible or native Responses API provider.

• LLM gateways

Casbin Gateway is a local dashboard and proxy that shows what every AI coding agent on a machine is doing, grades whether an API key's provider matches what was paid for, and centralizes model access, permissions and spend tracking across 44 vendors.

• LLM gateways
• Monitoring

CodexSaver is an MCP tool that turns Codex into a cost-aware router, delegating low-risk, easily verified work such as explanations, searches, reviews and bounded patches to a cheaper worker while keeping architecture, security and final review decisions in Codex itself.

• MCP servers
• LLM gateways

UncommonRoute is an automatic LLM router that plugs into Claude Code, Cursor, Codex or the OpenAI SDK, running locally to send each request to a cheaper or stronger model depending on how complex the request is.

• LLM gateways

A routing service and set of IDE plugins that sends a coding assistant's prompts to several language models at once and returns whichever answer wins on cost and quality, reached through a paid gateway API key.

• LLM gateways

An enterprise AI gateway that proxies OpenAI, Anthropic, Gemini and self-hosted LLM APIs plus MCP tool calls behind one control plane, with RBAC, audit logs, rate limiting and cost tracking.

• LLM gateways

A set of over 30 hands-on Jupyter notebook labs that show how to secure, meter and observe large language models, MCP servers and AI agents behind Azure API Management's AI Gateway.

• LLM gateways
• Tutorials

An enterprise-grade AI API gateway, built as an extended fork of one-api, that adds subscription plans, active-active clustering, and precise billing for reselling or managing access to multiple model providers.

• LLM gateways

AIHelms is an enterprise platform for managing an organization's AI resources: a unified gateway across providers such as OpenAI, Azure, Claude and DeepSeek, per-department budgets and token-level cost attribution, and registration of internal MCP tools and Skills.

• LLM gateways

Copilot API is a local AI gateway that exposes GitHub Copilot, a built-in Codex provider and configurable third-party model providers through one OpenAI- and Anthropic-compatible endpoint, so tools such as Claude Code, OpenCode and Codex can all talk to the same local server.

• LLM gateways

A self-hosted search gateway for AI agents that exposes a single Perplexity-compatible search API backed by several providers, falling back to the next one automatically if one is rate-limited or down.

• RAG
• LLM gateways