Stream Processing Python Packages

mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

faststream

FastStream is an asynchronous Python framework for building event-driven applications. It brings together message broker integration, dependency injection, validation, testing utilities, and AsyncAPI documentation generation in a single toolkit

hdx-python-utilities

A range of helpful utilities for Python developers including streaming tabular data, date parsing, JSON and YAML handling, dictionary and list utilities

river

🌊 Online machine learning in Python

quixstreams

Python Streaming DataFrames for Kafka

sentry-arroyo

A library to build streaming applications that consume from and produce to Kafka.

csp

csp is a high performance reactive stream processing library, written in C++ and Python

bytewax

Python Stream Processing

distogram

A library to compute histograms on distributed environments, on streaming data

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

mediapipe-nightly

Cross-platform, customizable ML solutions for live and streaming media.

faust

Python Stream Processing

mediapipe-model-maker

Cross-platform, customizable ML solutions for live and streaming media.

zef

Toolkit for graph-relational data across space and time

csp-gateway

csp-gateway is a framework for building high-performance streaming applications

dbt-materialize

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

csp-adapter-symphony

A csp adapter for symphony

gretel-client

The Gretel Python Client allows you to interact with the Gretel REST API.

ralph-malph

:gear: Ralph, the ultimate Learning Record Store (and more!) for your learning analytics

beavers

Python stream processing for analytics

creme

🌊 Online machine learning in Python

wingfoil

graph based stream processing framework

probstructs

Collection of probabilistic data structures - CM-Sketch, ECM-Sketch, exponential histogram

kafi

The Swiss Army Knife for Kafka