Data Streaming Python Packages

dagshub

DagsHub client libraries

lorrystream

A lightweight and polyglot stream-processing library, to be used as a data backplane-, message relay-, or pipeline-subsystem.

wax-ml

A Python library for machine-learning and feedback loops on streaming data

dbt-flink-adapter

The Flink adapter plugin for dbt

multiflow

A Python multithreading library for data processing pipelines, data streaming, etc.

affirmative-sampling

Reference implementation of the Affirmative Sampling algorithm by Jérémie Lumbroso and Conrado Martínez (2022). 🍀

sotastream

A library for data streaming and augmentation

randomhash

A simple, time-tested, family of random hash functions in Python, based on CRC32 and xxHash, affine transformations, and the Mersenne Twister.