Back to directory

LocalMind

A single web page that runs several AI models entirely inside the browser using hand-written WebGPU kernels, offering chat, image generation, document question-answering and OCR.

Visit website (opens in a new tab)localmind.naklitechie.com
LocalMind

LocalMind runs real AI models directly on the user's own device from a single web page, with the model downloading once, caching in the browser, and working offline afterward. It offers eleven local chat models ranging from a small model of about 140 megabytes up to a 27-billion-parameter model running entirely in the browser tab, plus Chrome's built-in Gemini Nano model, alongside on-device image generation, an experimental text-diffusion mode, document question-answering over uploaded files with multilingual search, and OCR that extracts selectable text and tables from images or scanned PDFs.

Everything runs on the user's GPU through WebGPU, and the only network request the page ever makes is an optional web search, sent only when the user presses a search button, using a search key the user supplies. Some models also accept images and audio for captioning, visual question-answering and voice input.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.