Back to directory

Simplicio Local

A local-first C++ runtime for CPU-only LLM inference with Apple Silicon acceleration, exposed through a unified command-line interface.

Simplicio Local

Simplicio Local is the local-inference edge of a small "Simplicio" ecosystem of separate repositories: this project provides a vendored CPU engine plus a native C++ runtime and Apple Silicon acceleration path, while sibling repositories cover repository context (simplicio-mapper), a reasoning runtime (simplicio-prompt) and a delivery loop (simplicio-sprint) that feed into it.

It is built with CMake and Ninja and wraps an Ollama or other custom upstream server as a practical chat backend behind a unified CLI offering doctor, plan, convert, chat and serve commands, with documentation covering MLX, Metal, its scheduler, memory and cache behavior. Historical "US4" naming remains in CLI flags, environment variables and file paths for compatibility, though it is not the project's current identity.

Playwright-based CLI smoke tests are described as its main end-to-end test path, and a changelog tracks the CMake project version and the starter package version separately.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.