Memory Estimation Python Packages

canifinetune

Estimate whether a Hugging Face model fits and fine-tunes on your local GPU.

torchmeter

TorchMeter⏲️: Your all-in-one tool for Pytorch model analysis, measuring Params, FLOPs/MACs(aka. MACC or MADD), Memory cost, Inference time and Throughput! ! 🚀