ORBIT
A self-hosted AI gateway that connects files, databases, APIs and MCP tools to local or hosted models behind one OpenAI-compatible API, with authentication, observability and an admin UI.
ORBIT (Open Retrieval-Based Inference Toolkit) sits between applications and the models, data and tools they need, so a deployment can move from a local prototype to a governed production system without changing its architecture. YAML-configured adapters connect files, SQL and NoSQL databases, vector stores, Elasticsearch, and REST/GraphQL or MCP tools, while one API contract routes to Ollama, llama.cpp, vLLM, OpenAI, Anthropic, Gemini, Bedrock, Microsoft Foundry, OpenRouter and others.
It can be deployed on-premises, in a private cloud or air-gapped, and includes RBAC, OIDC/SSO, identity allowlisting, per-key quotas, audit logs, moderation and file encryption for governance, plus provider fallbacks, retries, circuit breakers, health checks, metrics and hot adapter reloads for production resilience. It requires Python 3.11 or newer to run locally; hosted sandbox demos are also available without installing anything.