Map Reduce Python Packages

flox

Fast & furious GroupBy operations for dask.array

streamerate

Iterable Java8 style Streams for Python

yt-framework

Build scalable data pipelines on YTsaurus with automatic stage management, local development simulation, and more.

link-parallel

Parallel computing framework

prosto

Data processing toolkit radically changing the way data is processed

mpi-list

A package for working with lists distributed over MPI

pyredisgears

RedisGears python client

gearsclient

RedisGears python client

hadoop-protoseq

A small library example how to work with binary files with Hadoop Streaming.

pysqllike

Tentative to design map/reduce jobs (SQL, Pig)