Data Compression Python Packages

tensorflow-compression

Data compression in TensorFlow

3K 918 259

nanopq

Pure python implementation of product quantization for nearest neighbor search

1K 362 48

rgclib

Python wrapper for the C implementation of Recursive Group Coding (RGC)

1K 2 0

tensorflow-compression-ops

Data compression in TensorFlow

590 918 259

lzhw

Compression suite for data frames and tabular data files, csv, excel etc.

484 30 2

blackhole-blkh

Black Hole (BLKH) — Neural Implicit Compression with SIREN, DCT, Wavelet, AVIF

481 3 0

pyvq

Python bindings for the Vq library

378 24 2

pfc-jsonl

Python interface for PFC-JSONL — high-performance log compression with block-level timestamp filtering

351 5 0

dense-basis

SED fitting with non-parametric star formation histories

324 26 11

algorithmselector

A collection of various algorithms and data structures

307 2 0

rii

Fast and memory-efficient ANN with a subset-search functionality

274 154 20

py-rans

A lightweight rANSCoder meant for rapid prototyping.

215 22 3

cra5

A large compression model for weather and climate data, which compresses a 200+ TB ERA5 dataset into a new 0.7TB CRA5 dataset.

190 117 13

ravdec

Ravdec - Lossless Data Compression

118 1 2

tt-sketch

Sketching algorithms for Tensor Train decompositions

95 8 0