Memory Efficient Python Packages

madoka

Memory-efficient Count-Min Sketch Counter (based on Madoka C++ library)

came-pytorch

[ACL 2023] The official implementation of "CAME: Confidence-guided Adaptive Memory Optimization"

adv-optm

A family of highly efficient, lightweight yet powerful optimizers.

apollo-torch

APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention

savov-compact-tree

Compact, read-only nested dictionary backed by a DAWG-style radix trie

memory-efficient-attention-pytorch

Memory Efficient Attention - Pytorch

scarf

Toolkit for highly memory efficient analysis of single-cell RNA-Seq, scATAC-Seq and CITE-Seq data. Analyze atlas scale datasets with millions of cells on laptop.

fast-csv-loader

A fast and memory efficient way to load large CSV files (Timeseries data) in Pandas.

ringattention

Large Context Attention

diet-pandas

Automated memory optimization for Pandas DataFrames. Reduces memory by 50-80% and loads CSV 5-10x faster. Drop-in replacement that returns standard DataFrames - works with sklearn, matplotlib, and all your favorite libraries. Safe, fast, and zero refactoring required.

inf-cl

[CVPR 2025 Highlight] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A super memory-efficiency CLIP training scheme.

nexusquant-kv

Training-free KV cache compression via E8 lattice quantization and attention-aware token eviction

optimized-transducer

No description available

morris-counter

Memory-efficient probabilistic counter namely Morris Counter

scarf-toolkit

Toolkit for highly memory efficient analysis of single-cell RNA-Seq, scATAC-Seq and CITE-Seq data. Analyze atlas scale datasets with millions of cells on laptop.