Magnitude
An open-source inference engine that profiles a user's own hardware, recommends the best open models for it, and tunes them for that exact machine, running on Apple Silicon, NVIDIA, AMD or CPU-only setups.
Magnitude is a desktop app that estimates tokens-per-second for every model in its catalog before download, ranking them by speed, accuracy, intelligence and memory, then downloads, tunes (including speculative decoding) and runs the chosen model. The desktop app bundles the magnitude CLI, so no separate install is needed.
One click connects an existing agent such as Pi, OpenCode or Hermes to it. Models load on request and unload when idle or when memory fills, no token costs, API keys or rate limits apply, and models, prompts and files stay on the machine.
It is written in TypeScript, downloads for macOS, Windows and Linux, and is licensed under Apache-2.0.