Back to directory

Brevitas

A PyTorch research library for neural network quantization, supporting both post-training quantization and quantization-aware training for common layer types.

Brevitas

Brevitas is a PyTorch library for neural network quantization, supporting both post-training quantization and quantization-aware training. It provides quantized implementations of common PyTorch layers, such as convolutional, transposed-convolutional, multi-head attention, RNN and LSTM layers, and lets a user tune the quantization of different tensors, including inputs, weights, biases and outputs, independently for each layer.

As a reference workflow, it includes an example ImageNet classification flow that quantizes a torchvision model using post-training quantization under several configurations, such as different bit widths and scale granularities. It requires Python 3.10 or later and PyTorch between versions 1.13 and 2.13, runs on Windows, Linux or macOS, and installs from PyPI. The project explicitly describes itself as a research project rather than an official Xilinx product.

More in Models

See all 405
  • mini-AGI

    github.com

    A continual learning language model that trains from scratch on a single 8 GB VRAM GPU, assembling its own architecture and adapting its size to the hardware and data available rather than shipping as a fixed pretrained model.

  • An open-source contrastive-embedding pipeline that maps technical CVE vulnerability descriptions to formal cybersecurity compliance controls in NIST SP 800-53 and CMMC, published with its model generation, fine-tuning and evaluation code.

  • peekaboolean

    github.com

    A small vision-language model, fine-tuned with LoRA on a 500-million-parameter backbone, that answers typed multiple-choice, ordinal-score and yes/no questions about an image with calibrated probabilities, in about 400 milliseconds on a laptop.