Back to directory

Samosa Chat

A local chat application and HTTP gateway for running large language models entirely on a personal machine, with a model catalog for verified downloads and on-demand vision support for images and PDFs.

Samosa Chat

Samosa is a local model application and HTTP gateway for chatting with language models that run entirely on the user's own hardware, with no cloud account or telemetry. It starts with no models installed, and a browser interface lets the user download, verify and load models from a curated catalog, including options designed to run on a machine with as little as 16 gigabytes of RAM.

Chat images and PDFs are routed through local text and OCR extraction, with an on-demand visual specialist model brought in only when needed rather than kept resident, and inputs are bounded by the machine's current memory and thermal conditions. It includes an internet-search feature that needs no API key, and integrates a bundled local service for portable folder-based memory. Only one primary chat model is kept loaded in memory at a time.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.