Low Rank Python Packages

loralib

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

geotorch

Constrained optimization toolkit for PyTorch

adafactor8bit

8-bit Adafactor Optimizer with Fused CUDA Kernels

q-galore-torch

Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.

musco-pytorch

MUSCO: MUlti-Stage COmpression of neural networks

spatial-adapter

Spatial adapter for frozen predictors: low-rank residual decomposition, closed-form covariance, and kriging-style prediction.

lowrankdensity

Lowrankdensity

mfa-estimator

MFA-based estimator for linear inverse problems with complex-valued priors.

splora

Sparse and Low-Rank Paradigm Free Mapping.

sam-lora-lib

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

shadowkv

[ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference