PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Knowledge Distillation Python Packages

Python packages with the GitHub topic knowledge-distillation. Sorted by relevance, with stars and monthly downloads.
intel
neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

32K 3K 305
yzhao062
suod

(MLSys' 21) An Acceleration System for Large-scare Unsupervised Heterogeneous Outlier Detection (Anomaly Detection)

15K 395 46
PaddlePaddle
paddleclas

A treasure chest for visual classification and recognition powered by PaddlePaddle

5K 6K 1K
yoshitomo-matsubara
torchdistill

A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. 🎁 Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.

2K 2K 145
wpferrell
resonance-layer

Emotional intelligence layer for AI - detects emotion, tracks wellbeing, and gives any LLM the context to respond to how people actually feel.

2K 0 0
waking95
easy-zh-bert

easy-bert是一个中文NLP工具,提供诸多bert变体调用和调参方法,极速上手;清晰的设计和代码注释,也很适合学习

2K 83 14
MedAliAdlouni
ssondo

S-SONDO: Lightweight audio embeddings from self-supervised knowledge distillation

1K 5 0
intel
neural-compressor-pt

Repository of Intel® Neural Compressor

1K 3K 305
langformers
langformers

🚀 Unified NLP Pipelines for Language Models

1K 19 1
intel
neural-compressor-tf

Repository of Intel® Neural Compressor

1K 3K 305
open-mmlab
mmrazor

OpenMMLab Model Compression Toolbox and Benchmark.

831 2K 244
aquvitae
aquvitae

Knowledge Distillation Toolkit

820 88 10
Zakk-Yang
ollama-rag

A programming framework for knowledge management

652 7 4
GeoffreyWang1117
uni-layer

A Universal Framework for Layer Contribution Analysis

591 0 0
SforAiDL
kd-lib

A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.

536 650 61
burning-cost
insurance-distill

GBM-to-GLM distillation for insurance pricing - surrogate factor tables for Radar/Emblem rating engines

529 0 0
intel
neural-compressor-full

Repository of Intel® Neural Compressor

464 3K 305
intel
neural-solution

Repository of Intel® Neural Compressor

423 3K 305
intel
neural-insights

Repository of Intel® Neural Compressor

355 3K 305
yoshitomo-matsubara
sc2bench

[TMLR] "SC2 Benchmark: Supervised Compression for Split Computing"

303 35 11
intel
lpot

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

285 3K 306
alibaba
easytransfer

PAI EasyTransfer Toolkit

279 862 161
alibaba
pai-easynlp

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

231 2K 257
zhangyikaii
zhijian

ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse

108 48 2
    • Data from PyPI, GitHub, ClickHouse, and BigQuery