bitsandbytes
A "standard library" of Triton kernels.
Effortlessly quantize, benchmark, and publish Hugging Face models with cross-platform support for CPU/GPU. Reduce model size by 75% while maintaining performance.
Estimate whether a Hugging Face model fits and fine-tunes on your local GPU.
Simple & Cutting Edge LLM Finetuning
