Back to directory

Llama GUI

A lightweight local launcher and browser control panel for llama.cpp on Windows, macOS and Linux, covering installation, launching, chat, benchmarking and preset management.

Llama GUI

Llama GUI is a local launcher and control panel for llama.cpp. It installs prebuilt llama.cpp releases for a chosen backend, such as CPU, CUDA, Vulkan, SYCL or ROCm, and launches the llama-server or llama-cli binary either from a beginner-oriented Quick Launch or a full Configure screen, all through a browser-based interface.

It provides a chat view with streaming Markdown, a focus mode and collapsed reasoning output, plus optional web search with no API key; benchmarking through built-in benchmark and perplexity tools with live stats; OpenAI-compatible API usage snippets; and management of launch presets, including two presets kept on standby for quick switching, Windows shortcuts, and in-app updates from GitHub releases. Five built-in themes meet accessibility contrast guidelines.

It installs with a one-line script on macOS, Linux or Windows, needs Python for the installer itself, and its supported prebuilt backends vary by operating system and architecture.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.