Back to directory

Off Grid AI

A cross-platform on-device AI app for phone and Mac that runs GGUF language models, vision, Whisper speech-to-text and Stable Diffusion image generation entirely offline, with tool calling.

Off Grid AI

Off Grid AI is an on-device AI suite for phone and Mac that runs entirely offline, with no account, no API key, and no data leaving the device. Beyond ordinary text chat, it covers image generation, vision understanding, Whisper-based speech transcription, tool calling and document analysis, all running natively on the device's own hardware.

Its free tier runs GGUF models such as Qwen 3, Llama 3.2, Gemma 3 and Phi-4, with streaming responses and a thinking mode, and it detects and uses whatever acceleration hardware is available: Adreno GPUs through OpenCL, Apple Silicon through Metal, and an experimental path for Snapdragon Hexagon NPUs. An optional paid tier adds on-device text-to-speech for voice conversations, custom personas with persistent memory, a draft-then-approve mode that connects to Calendar, email and MCP servers such as Linear, Notion and GitHub, and a personal mesh that syncs chats, files and settings between a phone and a Mac over the user's own network with no relay server.

It is written in TypeScript, using React Native, and works on Android, iOS and macOS.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.