Mixed Precision Python Packages

axquant

Not another flat 4-bit quantizer. AXQuant mixes precision layer by layer for Apple Silicon—smaller MLX models, protected quality-critical layers, production-ready plans.

redco

NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference

xturing

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

gradient-accumulator

:dart: Gradient Accumulation for TensorFlow 2

profine

Profine automatically profiles and optimizes PyTorch training jobs on real GPUs, delivering measurable speedups and lower GPU costs before teams waste days tuning configs by hand.

pytorch-autotune

Measurement-driven PyTorch training autotuner — tries precision × torch.compile × memory-format configs on your model, keeps the fastest, never returns one slower than your baseline. Honest, committed benchmarks.

xtuning

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6