LLM gateways

A drop-in compression proxy that sits between a coding agent and its LLM API, stripping tool-schema bloat and compressing tool results and stale history to cut input-token bills without changing the agent.

• Coding agents
• LLM gateways

An open-source enterprise AI platform that unifies multi-provider model routing, multimodal chat, file and RAG retrieval, MCP tools, usage billing, identity and audit logs into one deployable product.

• RAG
• LLM gateways

An open-source API gateway that routes, manages and analyzes requests to multiple LLM providers behind one OpenAI-compatible interface, hosted or self-hosted with Docker.

• LLM gateways

A method-native AI work system and terminal CLI for coding that routes across GPT, Claude, DeepSeek, Qwen, Kimi, GLM and MiniMax, with persistent, resumable sessions and governed tools.

• Coding agents
• LLM gateways

A self-hosted, OpenAI-compatible LLM router with a managed failover safety net, letting a bring-your-own-key setup fall back to another provider automatically during an outage.

• LLM gateways

An open-source, cloud-native AI and API gateway and developer portal that connects more than 100 AI models behind one standardized API, alongside general API management, monitoring and a team developer portal.

• LLM gateways
• APIs

A Kubernetes-native control plane for provisioning, governing and monitoring AI agent instances across a team, with an AI gateway and security protections.

• LLM gateways
• Containers

An open-source control plane for AI and agent traffic, built on Envoy, that gives one OpenAI-compatible API across hosted model providers, self-hosted inference and MCP servers while centralizing credentials, routing, quotas and failover.

• LLM gateways

A Python library that provides one unified interface for calling any LLM provider, such as OpenAI, Anthropic, Azure, Mistral or Ollama, so switching providers is a one-line change rather than a code rewrite.

• LLM gateways

A self-hosted infrastructure layer that puts coding-agent harnesses such as Codex, Claude Code and Hermes behind one OpenAI Responses-compatible API, handling sessions, streaming, files, cancellation and failure handling through an open protocol.

• Coding agents
• LLM gateways

An open-source library and benchmark for routing each query to the most suitable large language model based on cost, performance, and task complexity.

• LLM gateways
• AI evals

A reverse proxy for Claude Code that normalizes device fingerprints, telemetry, and identity metadata sent to the Anthropic API so multiple machines look like one canonical client.

• Coding agents
• LLM gateways

A proxy server that lets Anthropic clients such as Claude Code send requests to Gemini or OpenAI models, or to Anthropic itself, by translating between the Anthropic API and each provider through LiteLLM.

• LLM gateways

A router and control center that lets the Codex CLI and desktop app, along with Claude Code, Cursor, and Gemini CLI, call external model providers such as Kimi, DeepSeek, and xAI instead of only their default backend.

• Coding agents
• LLM gateways

A runtime library that makes per-step model, budget and policy decisions inside an AI agent's execution loop, aiming to cut cost and latency while preserving output quality.

• LLM gateways

An open-source, enterprise AI platform that combines a chat interface for non-technical users, an LLM and MCP gateway for developers, and guardrails, observability and identity management, built on SSO, RBAC and sandboxed execution.

• MCP servers
• LLM gateways

An open-source registry and proxy that federates MCP, A2A and REST or gRPC APIs behind one endpoint, adding centralized governance, discovery, observability and plugin extensibility for AI infrastructure.

• MCP servers
• LLM gateways

An open-source proxy for agentic AI that provides connectivity, security, observability and governance for agent-to-LLM, agent-to-tool and agent-to-agent communication, built on the MCP and A2A protocols.

• MCP servers
• LLM gateways

A model router that sits in front of Anthropic, OpenAI and Gemini APIs and picks the best available model for each request using a small on-device embedder rather than a prompt-based heuristic.

• LLM gateways

A routing layer for building Mixture-of-Models systems across heterogeneous LLM infrastructure. It evaluates request signals, user preferences, and application policies to select or compose the right model path for each request.

• LLM gateways

An open-source AI gateway and LLM observability platform that logs, routes, and analyzes requests across model providers with a single line of code.

• LLM gateways
• AI evals

A microkernel AI agent that routes each turn to the cheapest capable model and runs the same loop across a CLI, web UI, and chat channels.

• Agent frameworks
• LLM gateways

An AI-native proxy server and data plane for agentic applications that centralizes LLM routing, agent orchestration, observability, and guardrails.

• LLM gateways
• AI evals

An open-source gateway that puts hosted, BYOK, and local language models behind one OpenAI-compatible API, with per-user spend limits and routing learned from production traffic.

• LLM gateways