Submit a resource

Navigation

Back to directory

TextGen

TextGen is a desktop application for running local LLMs with text, vision and tool-calling support, offering a chat UI plus an OpenAI and Anthropic-compatible API entirely offline.

Visit website (opens in a new tab)github.com
TextGen

Portable builds for Linux, Windows and macOS bundle everything needed to run GGUF (llama.cpp) models with CUDA, Vulkan, ROCm or CPU-only backends, with no separate dependency install. It supports instruct and character-based chat modes with templated prompt formatting, image attachments for visual understanding, text, PDF and DOCX file attachments, message editing, and conversation branching, plus a free-form notebook tab outside of chat turns.

Additional backends, including ExLlamaV3, Transformers and TensorRT-LLM, can be switched without restarting, and tool-calling supports web search, page fetching, custom Python-file tools and MCP servers. A separate tab handles LoRA fine-tuning and diffusion-model image generation, and the app runs with zero telemetry or external resource calls.

Python, AGPL-3.0 licensed.

More in Inference

See all 770

  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.

Cookies

We use necessary cookies to run the site. Measurement and marketing are optional; neither is used today. Privacy policy