Stream Processing Python Packages

mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

faststream

FastStream is a powerful and easy-to-use asynchronous Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS, MQTT and Redis.

river

🌊 Online machine learning in Python

quixstreams

Python Streaming DataFrames for Kafka

sentry-arroyo

A library to build streaming applications that consume from and produce to Kafka.

hdx-python-utilities

A range of helpful utilities for Python developers including streaming tabular data, date parsing, JSON and YAML handling, dictionary and list utilities

distogram

A library to compute histograms on distributed environments, on streaming data

bytewax

Python Stream Processing

csp

csp is a high performance reactive stream processing library, written in C++ and Python

riko

A Python stream processing engine modeled after Yahoo! Pipes

faust

Python Stream Processing

mediapipe-model-maker

Cross-platform, customizable ML solutions for live and streaming media.

mediapipe-nightly

Cross-platform, customizable ML solutions for live and streaming media.

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

gretel-client

The Gretel Python Client allows you to interact with the Gretel REST API.

zef

Toolkit for graph-relational data across space and time

dbt-materialize

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

ralph-malph

:gear: Ralph, the ultimate Learning Record Store (and more!) for your learning analytics

creme

🌊 Online machine learning in Python

beavers

Python stream processing for analytics

streamsx

Python core package for IBM Streams.

csp-gateway

csp-gateway is a framework for building high-performance streaming applications

probstructs

Collection of probabilistic data structures - CM-Sketch, ECM-Sketch, exponential histogram

deva

函数流，数据流，同步异步，事件驱动，多种模式channel