ROCm CLI
A command-line tool for setting up and running local AI models on AMD GPUs, shipped as a single prebuilt binary with a full-screen TUI dashboard for GPU telemetry, model serving and chat.
ROCm CLI ships as a single prebuilt binary for Linux and Windows, needing no existing Python, Rust or ROCm install, and bundles inference-engine adapters for Lemonade and vLLM. It can inspect the local environment, discover available engines and models, find a running service, and chat with a locally served model.
Its live dashboard, with GPU telemetry, model serving status and chat, requires Linux or WSL2; on Windows only the CLI and Lemonade-based serving are available, without the live dashboard or vLLM support. The minimum supported base is Ubuntu 24.04 or an equivalent glibc 2.38 with GLIBCXX_3.4.32, which the Lemonade engine is linked against.
The project is explicitly marked as a tech preview, with APIs, commands and behavior that may change without notice; an installer script downloads a bundle, verifies its SHA-256 checksum, and installs rocm and rocmd into ~/.local/bin.