Mapreduce Python Packages

tdigest

t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark

streamerate

Iterable Java8 style Streams for Python

pyxtension

Pure Python extensions library that includes Scala-like streams, Json with attribute access syntax, and other common use stuff

mr4mp

Thin MapReduce-like layer that wraps the Python multiprocessing library.

dpark

Python clone of Spark, MapReduce like computing framework supporting iterative algorithms.

madoop

A light weight MapReduce framework for education

pyrallel-lib

Yet another easy-to-use python3 parallel library for humans.

hadopy

Easy parallel map-reduce command line tool

mapyreduce

Lightweight and extensible library to execute MapReduce-like jobs in Python

dfspy

Distributed File System written in Python

mister

Approachable map/reduce jobs

mlmr

This library will help you easily parallelize your python code for all kind of data transformations in MapReduce fashion.