Back to directory

vla.cpp

A C++ inference engine built on llama.cpp for Vision-Language-Action robot policies, running open VLA models such as SmolVLA, GR00T and BitVLA as self-contained GGUF files without Python.

Visit website (opens in a new tab)fai-modelopt-tech.github.io
vla.cpp

vla.cpp is a C++ inference engine, built on llama.cpp, for Vision-Language-Action models used to drive robots. It runs open VLA policies including SmolVLA, Pi-Zero, BitVLA, Evo-1 and GR00T N1.5 through 1.7 under one runtime, with each policy packaged as a single self-contained GGUF file that needs no Python or PyTorch at inference time.

The resulting binaries run on CPU, Apple Silicon, CUDA GPUs from consumer cards down to Jetson-class boards, Intel GPUs and NPUs through SYCL and OpenVINO, and Qualcomm Snapdragon CPUs, Adreno GPUs and Hexagon NPUs through OpenCL and a Hexagon backend. It is built with CMake, which fetches and pins the matching llama.cpp version automatically with no patch or submodule required.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.