Back to directory

OpenModel

A gateway-first local model runtime and CLI that pulls, runs, and serves GGUF or Ollama models behind an OpenAI-compatible endpoint, with a dashboard, token telemetry, and an optional GPU capacity marketplace.

OpenModel

OpenModel is a gateway-first local model runtime distributed as an npm package, paired with a dashboard, a marketing site, and a separately deployable cloud API. Its CLI can pull models from Hugging Face GGUF files, direct artifact URLs, Ollama references, or contributed gateways; run them through llama.cpp or Ollama runtimes; and serve them behind OpenAI-compatible and Ollama-compatible local endpoints exposing chat completions, model listing, and installation and runtime-status routes.

Beyond local serving, it includes a worker enrollment and provider system for publishing GPU capacity and pricing, with heartbeats, assignment processing, earnings, and payouts, and a hyperscaler-style control plane with reservations, metering, fee snapshots, disputes, and settlement states, alongside a dashboard GPU marketplace showing worker health, earnings, and public availability. It also offers isolated agent VMs called BuilderStudio boxes, with Claude Code and Codex available as secondary agent options inside them.

Authentication uses OIDC device login for the CLI and OIDC Authorization Code with PKCE for the website; the cloud layer deploys to AWS Lambda and API Gateway, with the website on S3 and CloudFront.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.