Back to directory

llms.py

llms.py is a lightweight command-line tool, API and web chat interface for using multiple large language models entirely offline, keeping all data in the browser's own storage rather than any server.

llms.py

llms.py is a lightweight command-line tool, HTTP API and browser-based chat UI for working with multiple large language models. It positions itself as a ChatGPT-like alternative to Open WebUI.

It runs entirely offline, and all conversation data is kept private in the browser's own local storage rather than sent to or stored on any server.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.