Back to directory

ExecuTorch-rs

Rust bindings for Meta's ExecuTorch library, letting PyTorch models exported in Python be loaded and run on mobile, embedded and edge devices from Rust code.

ExecuTorch-rs

ExecuTorch-rs provides a high-level Rust API over ExecuTorch's C++ library for running PyTorch models on mobile, embedded and edge devices. A model is created and exported in Python as usual, then loaded and executed from Rust using this crate.

The crate requires the C++ ExecuTorch library to be compiled separately, since the needed modules, backends and operations depend on the target configuration, and each release of the Rust crate is tied to a specific ExecuTorch C++ version. Optional Cargo features add a data-loader module for additional input formats, a higher-level module API for loading and running models, and a tensor pointer type that manages a tensor's buffer and metadata together.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.