Back to directory

Llamatik

A Kotlin Multiplatform library for running large language models, speech-to-text and image generation fully on-device across Android, iOS, desktop and WASM, built on llama.cpp, whisper.cpp and stable-diffusion.cpp.

Llamatik

Llamatik exposes llama.cpp for LLM text generation, whisper.cpp for speech-to-text and stable-diffusion.cpp for image generation behind one unified Kotlin API, so an app written once in Kotlin Multiplatform can run all three fully offline on Android, iOS, desktop, JVM or WASM, with no Python and no required server.

Its LLM support covers streaming and non-streaming generation, schema-constrained JSON output, embeddings, configurable context length and Flash Attention, KV-cache session save and resume, concurrent inference sessions, chat-template introspection, and multi-token speculative prediction on supported models. The speech component adds segment-aware transcription with timestamps, optional translation to English and speaker-turn detection, and the image component covers text-to-image and image-to-image generation. MIT licensed.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.