Knowledge Distillation Python Packages

neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

suod

(MLSys' 21) An Acceleration System for Large-scare Unsupervised Heterogeneous Outlier Detection (Anomaly Detection)

paddleclas

A treasure chest for visual classification and recognition powered by PaddlePaddle

torchdistill

A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. 🎁 Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.

resonance-layer

Emotional intelligence layer for AI - detects emotion, tracks wellbeing, and gives any LLM the context to respond to how people actually feel.

easy-zh-bert

easy-bert是一个中文NLP工具，提供诸多bert变体调用和调参方法，极速上手；清晰的设计和代码注释，也很适合学习

ssondo

S-SONDO: Lightweight audio embeddings from self-supervised knowledge distillation

neural-compressor-pt

Repository of Intel® Neural Compressor

langformers

🚀 Unified NLP Pipelines for Language Models

neural-compressor-tf

Repository of Intel® Neural Compressor

mmrazor

OpenMMLab Model Compression Toolbox and Benchmark.

aquvitae

Knowledge Distillation Toolkit

ollama-rag

A programming framework for knowledge management

uni-layer

A Universal Framework for Layer Contribution Analysis

kd-lib

A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.

insurance-distill

GBM-to-GLM distillation for insurance pricing - surrogate factor tables for Radar/Emblem rating engines

neural-compressor-full

Repository of Intel® Neural Compressor

neural-solution

Repository of Intel® Neural Compressor

neural-insights

Repository of Intel® Neural Compressor

sc2bench

[TMLR] "SC2 Benchmark: Supervised Compression for Split Computing"

lpot

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

easytransfer

PAI EasyTransfer Toolkit

pai-easynlp

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

zhijian

ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse