Back to directory

weightlift

An in-browser model manager for local, on-device AI that handles download progress, cache detection, and deduplication of concurrent model loads, with React hooks and a worker bridge, working out of the box with Transformers.js.

weightlift

weightlift is a JavaScript library for loading and managing on-device AI models such as Whisper or CLIP inside a web browser, handling the parts of that problem a developer would otherwise have to wire up: tracking download progress, detecting when a model is already cached, deduplicating concurrent requests to load the same model, and bridging model execution into a web worker. It works with Transformers.js out of the box, picking WebGPU when available and falling back to WASM, and any custom model loader can be plugged in as well.

The library ships as a core model manager, an optional React package with hooks such as useModel and useModelManager, a worker package for running models off the main thread, and a Transformers.js integration package, with React and Transformers.js both treated as optional peer dependencies rather than requirements. It is used in at least one featured project, a transcript-based video editor that runs Whisper entirely on-device in the browser.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.