LLM gateways

A stateless, multi-provider .NET AI gateway exposing normalized OpenAI- and Anthropic-compatible endpoints, managed agents and skills across a very large catalog of models.

• LLM gateways

A self-hosted, protocol-first AI gateway and agent control plane for OpenAI, Anthropic, Gemini, MCP and A2A, turning a rough request into a structured, reviewable prompt before it runs.

• LLM gateways

A local AI gateway and desktop control desk that gives coding tools one steady endpoint, so switching between AI subscriptions, API providers and local models doesn't mean reconfiguring every client.

• LLM gateways

A self-hosted AI platform with a small core (RAG plus knowledge-graph memory, a provider-agnostic LLM gateway with fallback, and governance), a lifecycle manager that deploys, operates and scales the underlying infrastructure, and installable modules built on top.

• RAG
• LLM gateways

A small proxy that translates OpenAI-compatible chat requests into Mistral's native /v1/conversations endpoint, letting the 9router gateway reach a GLM-5.2 model through Mistral without hitting the rate limits on Mistral's OpenAI-compatible endpoint.

• LLM gateways

A self-hosted AI platform that puts inference, tool use, browser automation, image generation, speech synthesis, and other services behind one OpenAI-compatible endpoint, deployed with a single docker-compose up.

• MCP servers
• LLM gateways

A gateway-first local model runtime and CLI that pulls, runs, and serves GGUF or Ollama models behind an OpenAI-compatible endpoint, with a dashboard, token telemetry, and an optional GPU capacity marketplace.

• Inference
• LLM gateways

A reverse proxy for coding agents such as Claude Code, Codex CLI, and Cursor that filters each request's MCP tool catalog down to only the tools relevant to the current task, cutting token overhead.

• MCP servers
• LLM gateways

A set of components for building an AI gateway on top of the Praxis proxy, adding provider-aware routing, protocol translation, response storage, guardrails, and observability at the proxy layer.

• LLM gateways

A single-binary Rust gateway that caches and routes LLM requests from coding tools such as Copilot, Claude, and Cursor across multiple providers, aiming to deflect most redundant traffic before it reaches the cloud.

• LLM gateways

Open-source middleware that compiles LLM tool-calling schemas into a reusable key-value cache on disk, so repeated tool definitions are not reprocessed on every request, keeping response latency flat regardless of tool count.

• LLM gateways

A local AI load balancer that turns a set of Mac and other devices running Ollama into one cluster, auto-discovering nodes over mDNS and routing language-model, image, speech and embedding requests to the best-fit device.

• Inference
• LLM gateways

A personal AI workspace and runtime that acts as a control plane for agent work: a local gateway for chatting with model providers, running Hecate's own tasks, and supervising external coding-agent sessions with approvals and full tracing.

• Coding agents
• LLM gateways

An OpenAI-compatible gateway for attested confidential inference that publishes hardware attestation for itself, verifies its upstream model providers before forwarding a prompt, and signs a receipt for every response.

• LLM gateways
• Security

A single-file, dependency-free transparent proxy that lets the Codex CLI or desktop app call NVIDIA NIM's free-hosted models, such as DeepSeek V4 Pro and Qwen3 Coder, using a user's own NVIDIA account.

• LLM gateways

An open-source AI agent platform and LLM gateway that unifies more than 170 models through MCP and LangGraph orchestration, with row-level multi-tenant security, a RAG knowledge base and an agent marketplace.

• Agent frameworks
• LLM gateways

A zero-dependency local proxy that lets the Codex CLI call DeepSeek, MiMo or other chat-completion models by translating between OpenAI's Responses API and the Chat Completions API, with a desktop UI for managing providers and keys.

• LLM gateways

This project wires the Hermes autonomous agent directly to a local llama.cpp model, and optionally bridges Claude Code through a local LiteLLM proxy, so an agent can plan tasks, call tools and edit files entirely on a user's own hardware with no per-token API cost.

• Agent frameworks
• LLM gateways

MELLM routes a query to a small, domain-specific expert model instead of a single large general model, keeping only one specialist loaded in VRAM at a time so consumer GPUs can get expert-level answers.

• Inference
• LLM gateways

An HTTP gateway that sits between AI clients and the Anthropic and OpenAI APIs, recording token usage, prompts and tool calls per user and optionally injecting a centrally managed set of MCP tools.

• LLM gateways

A self-hosted proxy that sits between an application and any LLM provider, redacting personal data and secrets and blocking prompt-injection attempts before a request reaches the model.

• LLM gateways
• Security

A terminal AI agent, built on Elixir/OTP with a Rust interface, that classifies a request, filters out noise, and routes work to the right model, supporting any provider including an existing subscription.

• Coding agents
• LLM gateways

A self-hosted, multi-provider AI gateway that exposes one OpenAI-compatible endpoint in front of every configured LLM provider, auto-discovering available models, forming automatic failover groups around shared model names, and storing no prompt data by design.

• LLM gateways

A plugin for the Hermes Agent framework, installed through Hermes's own plugin hooks without changing its core code, adding model-tier routing by task difficulty, a circuit breaker for repeated failures, and a self-healing error-pattern library.

• Agent frameworks
• LLM gateways