Back to directory

TiyGate

A lightweight Rust gateway that unifies OpenAI-compatible, Anthropic Messages and Gemini protocols behind one control plane, with policy-based routing, failover and request logging across multiple LLM providers.

TiyGate

TiyGate sits between applications and upstream LLM providers such as OpenAI, Anthropic, Bedrock and Gemini, turning fragmented provider access, subscriptions and API keys into one stable control plane. Virtual models route requests across providers by priority, weight, throughput or latency, with automatic failover and recovery when an upstream model becomes unstable.

It captures detailed request and response logs across the client-to-provider path for debugging, with retention-policy cleanup and an optional S3-compatible archive, and aggregates usage analytics across providers, models and API keys. Provider API keys are encrypted at rest, and sensitive log fields are redacted.

It runs as a zero-config desktop app for personal use on macOS or Windows, or in containers for enterprise deployments that separate the data plane from the control plane, and supports encrypted configuration export and import for backup or migration. It is written in Rust and licensed under Apache-2.0.

More in LLM gateways

See all 106
  • aihappey-ai

    github.com

    A stateless, multi-provider .NET AI gateway exposing normalized OpenAI- and Anthropic-compatible endpoints, managed agents and skills across a very large catalog of models.

  • Unified AI System

    happy520ai.github.io

    A self-hosted, protocol-first AI gateway and agent control plane for OpenAI, Anthropic, Gemini, MCP and A2A, turning a rough request into a structured, reviewable prompt before it runs.

  • Subroute

    github.com

    A local AI gateway and desktop control desk that gives coding tools one steady endpoint, so switching between AI subscriptions, API providers and local models doesn't mean reconfiguring every client.