Back to directory

mlx-workspace

A workspace for running and benchmarking local LLMs on Apple Silicon with MLX, built to measure which local model can handle routine coding operations well enough to replace paid cloud requests in an internal coding tool.

mlx-workspace

mlx-workspace runs large language models locally on Apple Silicon using MLX and connects AI coding tools to that local server so their actual capability on real tasks can be measured, rather than assumed. Its purpose is answering one question for its parent project, nav-pilot: which local model is good enough to absorb routine coding operations that would otherwise consume a paid Copilot request.

A generated manifest lists the models currently shipped to nav-pilot users, each with its context size, sampling and prompt-cache tuning, memory requirements, minimum supported client version, and the specific task classes it has been verified to handle, with evidence linked to written decision records. Models that do not yet meet the bar are parked rather than shipped, and every task class not yet verified against a given model continues to run on the cloud model instead.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.