Low Rank Python Packages

loralib

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

geotorch

Constrained optimization toolkit for PyTorch

adafactor8bit

Memory-efficient PyTorch optimizers with Adaptive Log-Space quantization, fused CUDA kernels, and Adafactor, CAME, APOLLO support.

q-galore-torch

Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.

lowrankdensity

Lowrankdensity

hakuli

Apache-2.0 clean-room implementation of APOLLO for memory-efficient full-parameter LLM training.

spatial-adapter

Spatial adapter for frozen predictors: low-rank residual decomposition, closed-form covariance, and kriging-style prediction.

splora

Sparse and Low-Rank Paradigm Free Mapping.

mfa-estimator

PyPI package for MFA-based estimation in complex-valued linear inverse problems.

musco-pytorch

MUSCO: MUlti-Stage COmpression of neural networks

shadowkv

[ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference

sam-lora-lib

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"