SwarmLLM
A free desktop app that runs open AI chat models locally, and lets multiple computers running SwarmLLM team up over the internet to run models too large for one machine.
Visit website (opens in a new tab)enapt.github.io
SwarmLLM gives a ChatGPT-style assistant that runs on the user's own computer using open models from Meta, Google, Alibaba, Mistral and others. When a model is too large for one machine, computers running SwarmLLM can join over the internet and each hold part of the model, splitting the work between them.
The app requires no account, subscription, or cryptocurrency, is open source, and updates itself. It exposes an OpenAI- and Anthropic-compatible API and is written in Rust, with builds available for Windows and Apple silicon Macs.