# Gerbil

A cross-platform desktop app, powered by KoboldCpp, for running large language models and generating images locally on a person's own hardware, with no telemetry, accounts or external servers.

Gerbil runs LLMs through KoboldCpp, a fork of llama.cpp, on Windows, macOS and Linux including Wayland, working on CPU-only systems as well as with GPU acceleration through CUDA, ROCm, Vulkan or Metal. It can import pre-downloaded KoboldCpp binaries and run fully offline, and includes built-in presets for image-generation workflows using Flux, Chroma, Qwen Image and Z-Image.

An integrated Hugging Face search browses models, views model cards, and downloads GGUF files directly from the app. It can also launch SillyTavern, for advanced character interactions, and OpenWebUI, for a web-based chat interface, as companion integrations when their own prerequisites (Node.js or `uv`) are present.

Pre-built binaries are provided for Windows, macOS and Linux, and an AUR package is available for Arch Linux; on macOS, the app must be manually removed from quarantine since it is not notarized by Apple.

Website: https://github.com/lone-cloud/gerbil