Dataflow Python Packages

marimo

A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

nipyapi

A convenient Python wrapper for Apache NiFi

marimo-base

A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

nipype

Workflows and interfaces for neuroimaging packages

ipyflow-core

A reactive Python kernel for Jupyter notebooks.

bytewax

Python Stream Processing

bigflow

A Python framework for data processing on GCP.

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

pytm

A Pythonic framework for threat modeling

ipyflow

A reactive Python kernel for Jupyter notebooks.

biggerquery

A Python framework for data processing on GCP.

marimo-agents

A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

slipstream-async

Slipstream provides a data-flow model to simplify development of stateful streaming applications.

lachesis-cpg

Compiler-precise code property graph for C, Python, and TypeScript, navigable over MCP — data- and taint-flow with source→sink witnesses, points-to, and guard/sink structure for security reasoning over source.

python-taint

A Static Analysis Tool for Detecting Security Vulnerabilities in Python Web Applications

wingfoil

ultra low latency graph based stream processing framework

finn-plus

FINN+ is an extended version of FINN, a dataflow compiler for QNN inference on FPGAs. It is maintained by a group of researchers at Paderborn University, Germany.

lm-lmflow

A dataflow-graph engine: Rust core + stable C ABI + C++/Python kernels. Timestamped packets, backpressure and parallel thread-pool scheduling; runs on Linux, macOS, iOS, Android and HarmonyOS.

substrate-kernel

A Python runtime that coordinates models and anything else you want through a single append-only log. Replay, diff, and trace every run.

nbsafety

A reactive Python kernel for Jupyter notebooks.

finn-plus-driver

FINN+ is an extended version of FINN, a dataflow compiler for QNN inference on FPGAs. It is maintained by a group of researchers at Paderborn University, Germany.

pyclink

Stream processing for Kafka pipelines that must stay correct when processes die. SQL, event time, keyed state and exactly-once delivery in modern C++: one process on a laptop, embedded, or a cluster. No JVM.

pybeamguard

Apache Beam & Dataflow pipeline analysis platform: pre-deployment validation, cost forecasting, hot key detection, reliability analysis, and best practices engine. Free proprietary software for data engineers.

pythonflow

:snake: Dataflow programming for python.