Back to directory

TensorFlow Model Optimization Toolkit

A TensorFlow toolkit that optimizes Keras and TensorFlow models for deployment through techniques such as quantization and pruning for sparse weights.

TensorFlow Model Optimization Toolkit

TensorFlow Model Optimization Toolkit is a suite of tools, aimed at both novice and advanced users, for optimizing machine learning models for deployment and execution. Supported techniques include quantization and pruning for sparse weights, with APIs built specifically for Keras, and it is distributed as a set of stable Python packages installable alongside TensorFlow.

Different subpackages, covering clustering, quantization and sparsity, are maintained by TensorFlow's own optimization team and by Arm ML Tooling for the clustering component. The project's website hosts an overview of the individual tools, documented optimization gains, a roadmap, tutorials and API documentation, and contributions follow TensorFlow's standard contribution guidelines and code of conduct.

More in Models

See all 405
  • mini-AGI

    github.com

    A continual learning language model that trains from scratch on a single 8 GB VRAM GPU, assembling its own architecture and adapting its size to the hardware and data available rather than shipping as a fixed pretrained model.

  • An open-source contrastive-embedding pipeline that maps technical CVE vulnerability descriptions to formal cybersecurity compliance controls in NIST SP 800-53 and CMMC, published with its model generation, fine-tuning and evaluation code.

  • peekaboolean

    github.com

    A small vision-language model, fine-tuned with LoRA on a 500-million-parameter backbone, that answers typed multiple-choice, ordinal-score and yes/no questions about an image with calibrated probabilities, in about 400 milliseconds on a laptop.