Pruning Python Packages

nncf

Neural Network Compression Framework for enhanced OpenVINO™ inference

tensorflow-model-optimization

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

aimet-torch

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

cozempic

Context cleaning for Claude Code — prune bloated sessions, protect Agent Teams from context loss, auto-guard with tiered pruning

neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

torch-pruning

[CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.

aimet-onnx

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

tf-model-optimization-nightly

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

sparsezoo

Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes

deepsparse

Sparsity-aware deep learning inference runtime for CPUs

sparseml

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

retinal-thin-vessels

A Python package for computing the recall and precision scores specifically on thin vessels in retinal images and generating weight masks for BCE Loss to enhance models perfomance on segmenting these fine structures, as detailed in the paper "Vessel-Width-Based Metrics and Weight Masks for Retinal Blood Vessel Segmentation".

neural-compressor-pt

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

sconce

E2E AutoML Model Compression Package

optipfair

Structured pruning, knowledge distillation, and fairness analysis for Large Language Models.

mmrazor

OpenMMLab Model Compression Toolbox and Benchmark.

deepsparse-ent

Sparsity-aware deep learning inference runtime for CPUs

thekaveh-nnx

Lightweight PyTorch toolkit for training, fine-tuning, and exporting modern neural nets. FFN + GNN + decoder-only LM + diffusion + JEPA + MoE; PEFT (LoRA/DoRA/IA3/Prefix/Prompt), PTQ/QAT, pruning, surgery; ONNX/GGUF/Ollama/HuggingFace Hub interop. Dataclass-configured runs with fluent builders, automatic checkpointing, and Plotly viz.

neural-compressor-tf

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

delve

PyTorch model training and layer saturation monitor

micronet

A model compression and deploy lib.

aimet-tensorflow

AIMET for TensorFlow

torch-optim

PyTorch models optimization by neural network pruning

fasterai

FasterAI: Prune and Distill your models with FastAI and PyTorch