Gerbil
A cross-platform desktop app, powered by KoboldCpp, for running large language models and generating images locally on a person's own hardware, with no telemetry, accounts or external servers.
Gerbil runs LLMs through KoboldCpp, a fork of llama.cpp, on Windows, macOS and Linux including Wayland, working on CPU-only systems as well as with GPU acceleration through CUDA, ROCm, Vulkan or Metal. It can import pre-downloaded KoboldCpp binaries and run fully offline, and includes built-in presets for image-generation workflows using Flux, Chroma, Qwen Image and Z-Image.
An integrated Hugging Face search browses models, views model cards, and downloads GGUF files directly from the app. It can also launch SillyTavern, for advanced character interactions, and OpenWebUI, for a web-based chat interface, as companion integrations when their own prerequisites (Node.js or uv) are present.
Pre-built binaries are provided for Windows, macOS and Linux, and an AUR package is available for Arch Linux; on macOS, the app must be manually removed from quarantine since it is not notarized by Apple.