Back to directory

Atomic Chat

A local desktop and mobile app that runs open-weight LLMs offline and exposes them through a drop-in, OpenAI-compatible local API for agents, CLIs and IDE plugins.

Atomic Chat

Atomic Chat is a local AI app and inference engine for running open-weight language models such as Llama, Gemma, Qwen, Mistral and Phi entirely on a user's own machine, with desktop and mobile builds. Loading a model in the app starts an OpenAI-compatible server bound to localhost by default, so any client that speaks the OpenAI API, including agents, CLIs and IDE plugins, can point at it with only the base URL changed; setting the host to 0.0.0.0 exposes it to the local network.

It supports speculative decoding techniques such as multi-token prediction and block-diffusion decoding for a throughput boost on supported models, a key-value cache quantization mode that shrinks memory footprint on CPU and GPU across Windows, Linux and macOS, and built-in cloud providers including OpenAI, Anthropic, Mistral, Groq, MiniMax, Qwen and Moonshot for mixing local and cloud models in the same chat. It can launch other coding agents, such as Claude Code, Codex CLI and OpenCode, directly from an integrations tab, and includes a live preview panel for generated HTML, CSS and JavaScript. It is written in TypeScript.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.