Back to directory

vLLM Playground

vLLM Playground is a web interface for running, managing and chatting with vLLM inference servers, supporting GPU and CPU backends including Apple Silicon and OpenShift or Kubernetes deployment.

vLLM Playground

vLLM Playground provides a web UI for managing and interacting with vLLM inference servers. It supports GPU and CPU modes with optimizations for Apple Silicon Macs and for enterprise deployment on OpenShift and Kubernetes, and it can run subprocess, container, and remote vLLM servers side by side, switching between saved configurations from a management screen.

Features include image and speech generation through vLLM-Omni integration, running Claude Code against locally served open models, MCP tool support with human-in-the-loop approval, chat with vision-language models such as Qwen2.5-VL and LLaVA, and per-model routing for gateways that expose a dedicated base URL per model. It installs from PyPI and includes an observability dashboard, a PagedAttention visualizer and speculative-decoding support.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.