Back to directory

Pocket LLM for Android

An Android app that runs Gemma, Qwen and LLaMA language models entirely on the phone for offline, private chat, including voice input, image input with OCR and camera-based prompting.

Pocket LLM for Android

Pocket LLM ships as a small base APK and lets the user download only the models they want to use, switching between them and deleting unused ones to save storage. It supports ONNX-based Qwen models and LiteRT-based Qwen 3 and Gemma 4 models, with streaming responses, persistent local chat history and Markdown-rendered replies.

Recent additions include voice input, image input with OCR and native image understanding, camera capture with retake and crop, a side panel for previous chats, editable model instructions with presets, and light and dark themes with adjustable font size. It runs fully offline after a model is downloaded, sends no telemetry, and is written in Kotlin using the LiteRT and ONNX Runtime backends.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.