Back to directory

Modelplane

A self-hosted, Kubernetes-based control plane, built on Crossplane, that provisions and schedules AI inference across any GPU infrastructure and exposes each deployed model behind one OpenAI-compatible endpoint.

Modelplane

Modelplane is software a team installs and runs in its own environment to orchestrate AI models, the serving engines running them, and the infrastructure underneath, across cloud, neocloud, and on-premises hardware, from a single GPU to disaggregated multi-node deployments. Built on the Crossplane project, it continuously reconciles a fleet toward a declared state: provisioning inference clusters, scheduling deployments onto compatible clusters, scaling replicas, caching model weights, and routing traffic.

The intended split of responsibility is that platform teams provision clusters and publish available hardware classes, while developers declare a model with a manifest and receive a unified, OpenAI-compatible endpoint, without either side needing to understand the other's job in detail. It is an early-stage project under active development, with APIs still subject to change, and is Apache 2.0 licensed.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.