Back to directory

ODS

A self-hosted deployment system that installs and wires together a private AI server, combining local model inference, a chat web UI, automation, and search.

ODS

ODS (Osmantic Deployment System) installs and connects Ollama, Open WebUI, n8n, ComfyUI, and related privacy tools so a PC, Mac, or Linux box can run as a private AI server without assembling each piece by hand. It provides local model inference, a ChatGPT-style web interface, a control dashboard for models and services and GPU status, voice and workflow automation, retrieval-augmented search over local documents, local image generation, and centralized service authentication and diagnostics.

No cloud account or subscription is required, and prompts and data stay on the machine unless the user opts into a cloud or hybrid mode. The current V3 release is in public pre-release testing, validated against a release fleet covering fresh installs and lifecycle recovery, ahead of its official launch.

It is written in Python.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.