Back to directory

ComfyUI-MultiGPU v2

A ComfyUI custom node that adds one-click virtual VRAM and multi-GPU distribution for UNet, CLIP and VAE loaders, offloading model layers to other devices to free VRAM for larger generations.

ComfyUI-MultiGPU v2

ComfyUI-MultiGPU adds custom nodes that let a UNet, CLIP or VAE loader offload part of a model to a donor device, such as system RAM or another GPU's VRAM, instead of keeping everything on the main compute card. This does not add parallel processing; workflow steps still run sequentially, but freeing VRAM this way lets a workflow handle a larger latent space, such as longer videos or more concurrent images, and can also speed things up by avoiding repeated model loading and unloading when VRAM is tight.

Its second version, called DisTorch2, adds native support for both plain safetensors models and GGUF-quantized models, up to ten percent faster GGUF inference than the first DisTorch approach, dedicated integration nodes for WanVideoWrapper, and two model-driven allocation modes, by byte count or by ratio, alongside the original virtual-VRAM slider.

The repository is set to be archived on 30 September 2026 and will no longer receive updates from its maintainer; fork maintainers are asked to announce themselves in a pinned coordination issue, though no fork is officially endorsed. It is written in Python and released under the GPL-3.0 license.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.