nextjs-vllm-ui
A self-hosted, ChatGPT-style web interface for vLLM and Ollama, built with Next.js, that runs entirely in the browser with chats stored in local storage.
nextjs-vllm-ui is a web interface for chatting with a locally or self-hosted vLLM or Ollama server, forked from an existing Ollama-focused UI project. It stores chat history in the browser's local storage rather than a database, works on both desktop and mobile, highlights code blocks with one-click copying, and supports light and dark themes.
It is distributed as a Docker image, run by pointing an environment variable at a running vLLM, or, with two further variables set, an Ollama, server, including over a Docker host network when the model server runs on a different address. For local development it can also be cloned and run directly with Node.js 18 or newer.