Map Reduce Python Packages

flox

Fast & furious GroupBy operations for dask.array

162K 137 24

streamerate

Iterable Java8 style Streams for Python

2K 8 3

yt-framework

Build scalable data pipelines on YTsaurus with automatic stage management, local development simulation, and more.

390 28 0

chainmill

Parallel ingest of zipped option-chain archives into a queryable SQLite store. Resumable builds, per-archive failure isolation, coverage reporting.

159 0 0

mpi-list

A package for working with lists distributed over MPI

153 5 0

link-parallel

Parallel computing framework

139 0 0

prosto

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

125 92 5

pyredisgears

RedisGears python client

95 27 11

gearsclient

RedisGears python client

80 27 11

pysqllike

Tentative to design map/reduce jobs (SQL, Pig)

53 2 0

hadoop-protoseq

A small library example how to work with binary files with Hadoop Streaming.

45 1 0