Mapreduce Python Packages

tdigest

t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark

pyxtension

Pure Python extensions library that includes Scala-like streams, Json with attribute access syntax, and other common use stuff

streamerate

Iterable Java8 style Streams for Python

dpark

Python clone of Spark, a MapReduce alike framework in Python

mr4mp

Thin MapReduce-like layer that wraps the Python multiprocessing library.

madoop

A light weight MapReduce framework for education

pyrallel-lib

Yet another easy-to-use python3 parallel library for humans.

hadopy

Easy parallel map-reduce command line tool

mapyreduce

Lightweight and extensible library to execute MapReduce-like jobs in Python

dfspy

Distributed File System written in Python

mister

Mister attempts to make running a map/reduce job approachable

mlmr

This library will help you easily parallelize your python code for all kind of data transformations in MapReduce fashion.