Data Streaming Python Packages

dagshub

DagsHub client libraries

lorrystream

A lightweight and polyglot stream-processing library, to be used as a data backplane-, message relay-, or pipeline-subsystem.

dbt-flink-adapter

Adapter for dbt that executes dbt pipelines on Apache Flink

wax-ml

A Python library for machine-learning and feedback loops on streaming data

multiflow

A Python multithreading library for data processing pipelines, data streaming, etc.

affirmative-sampling

Reference implementation of the Affirmative Sampling algorithm by Jérémie Lumbroso and Conrado Martínez (2022).

randomhash

A simple, time-tested, family of random hash functions in Python, based on CRC32 and xxHash, affine transformations, and the Mersenne Twister.

sotastream

A library for data streaming and augmentation