Back to directory

Minimal CPU-only Ollama Docker Image

A 70 megabyte Docker image that runs Ollama on CPU only, built to be far smaller and faster to deploy than the official four-gigabyte Ollama image on systems without a GPU.

Minimal CPU-only Ollama Docker Image

This project packages Ollama into a minimal Docker image built on wolfi.dev rather than Alpine, aimed at systems that only need CPU-based inference and do not have a GPU available. At about 70 megabytes, it is significantly smaller and faster to pull than the official Ollama image, while still exposing Ollama's normal API on the standard port once running.

It is meant to run anywhere a GPU is not available or not needed, such as local servers, edge devices, or cloud environments without GPU instances, for tasks like analyzing or streamlining logs with a local language model. Models are pulled and cached the same way as with the official image, and a separate web interface can be layered on top for chatting with the running model.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.