Memory Efficient Python Packages

madoka

Memory-efficient Count-Min Sketch Counter (based on Madoka C++ library)

adv-optm

A family of highly efficient, lightweight yet powerful optimizers.

came-pytorch

[ACL 2023] The official implementation of "CAME: Confidence-guided Adaptive Memory Optimization"

adafactor8bit

8-bit Adafactor Optimizer with Fused CUDA Kernels

apollo-torch

APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention

faceflash

Face search engine: 100% recall at 96x less memory than HNSW. Register photos, identify people from camera/video/images. AVX-512 + Rust. No GPU needed.

nexusquant-kv

Training-free KV cache compression via E8 lattice quantization; fits longer context in the same VRAM

savov-compact-tree

Compact tree representation in storage implemented in Python3 and C

memory-efficient-attention-pytorch

Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"

fast-csv-loader

A fast and memory efficient way to load large CSV files (Timeseries data) in Pandas.

scarf

Toolkit for highly memory efficient analysis of single-cell RNA-Seq, scATAC-Seq and CITE-Seq data. Analyze atlas scale datasets with millions of cells on laptop.

inf-cl

A highly memory-efficient contrastive loss.

diet-pandas

Automated memory optimization for Pandas DataFrames. Reduces memory by 50-80% and loads CSV 5-10x faster. Drop-in replacement that returns standard DataFrames - works with sklearn, matplotlib, and all your favorite libraries. Safe, fast, and zero refactoring required.

ringattention

RingAttention for Transformers with Arbitrarily Large Context.

optimized-transducer

No description available

morris-counter

Memory-efficient probabilistic counter namely Morris Counter

scarf-toolkit

Toolkit for highly memory efficient analysis of single-cell RNA-Seq, scATAC-Seq and CITE-Seq data. Analyze atlas scale datasets with millions of cells on laptop.