OrcaRouter Lite
A self-hosted, OpenAI-compatible LLM router with a managed failover safety net, letting a bring-your-own-key setup fall back to another provider automatically during an outage.
OrcaRouter Lite is the open-source, single-workspace edition of OrcaRouter, a self-hosted router for large language model requests. It exposes an OpenAI-compatible API, so an existing OpenAI SDK client can point at it, and it supports an automatic routing mode that can absorb a provider outage in real time without a code change, using a managed fallback service.
It runs locally through Docker Compose using a bring-your-own-key setup, printing an API key at startup that a client uses against a local base URL, or it can be paired with a hosted service that adds routing, billing and support for many additional providers. It streams responses and is written in Python under the MIT license.