llama-cpp-python-wheels
A collection of pre-built Python wheels for llama-cpp-python covering different operating systems, Python versions and CUDA architectures, so users do not have to compile the CUDA extension themselves.
This repository is a set of pre-built wheels for llama-cpp-python across platforms and CUDA versions, saving a user from compiling the CUDA extension locally. Wheels are organized by GPU generation and are built for specific combinations of the llama-cpp-python version, operating system, Python version and CUDA toolkit version.
Coverage spans consumer and workstation Blackwell GPUs such as the RTX 50 series and RTX PRO Blackwell cards, datacenter Blackwell cards such as the B100, B200 and B300, and RTX 40 series and Ada professional cards such as the RTX 4090 and the L40S, currently built for Windows.