Mapreduce Python Packages

tdigest

t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark

streamerate

Iterable Java8 style Streams for Python

pyxtension

Pure Python extensions library that includes Scala-like streams, Json with attribute access syntax, and other common use stuff

madoop

A light weight MapReduce framework for education

dpark

Python clone of Spark, a MapReduce alike framework in Python

pyrallel-lib

Yet another easy-to-use python3 parallel library for humans.

mr4mp

Thin MapReduce-like layer that wraps the Python multiprocessing library.

hadopy

Easy parallel map-reduce command line tool

mapyreduce

Lightweight and extensible library to execute MapReduce-like jobs in Python

dfspy

Distributed File System written in Python

mlmr

This library will help you easily parallelize your python code for all kind of data transformations in MapReduce fashion.

mister

Mister attempts to make running a map/reduce job approachable