Back to directory

LM WebUI

A local-first control plane for running and operating models, inference runtimes, agents, tools and retrieval from one privacy-first workspace, across local and cloud environments.

LM WebUI

It brings together separate models, runtimes, agents, tools and retrieval systems that would otherwise each need their own dashboard, aiming to make it easier to configure, monitor, debug and control an AI workload as a whole.

An intent-routing system automatically decides what a given request needs, such as plain chat, file handling, retrieval, web search, vision or image generation, without the user manually switching models or configuration, aiming to keep unnecessary processing off constrained hardware.

It installs with a one-line shell script that sets it up as a system service, storing models, data and configuration under a local directory by default, and supports GGUF and MLX models alongside OpenAI- and Gemini-compatible cloud providers.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.