PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Parallel Processing Python Packages

Python packages with the GitHub topic parallel-processing. Sorted by relevance, with stars and monthly downloads.
AnswerDotAI
fastcore

Python supercharged for the fastai library

48.9M 1K 295
swansonk14
p-tqdm

Parallel processing with progress bars

166K 493 39
exaxorg
accelerator

The Accelerator is a tool for fast and reproducible processing of eBay-scale datasets on a single computer.

38K 4 2
sail-sg
envpool

C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.

28K 1K 137
bug-ops
fastyaml-rs

Parse YAML at Rust speed. Full 1.2.2 spec, built-in linter, parallel processing. Native bindings for Python & Node.js.

16K 7 1
esa
pygmo

A Python platform to perform parallel computations of optimisation tasks (global and local) via the asynchronous generalized island model.

16K 529 68
dotflow-io
dotflow

🎲 Dotflow turns an idea into flow! — Lightweight Python library for execution pipelines

4K 7 8
kmatarese
glide

Easy ETL

4K 17 2
black-yt
structai

StructAI offers a robust toolkit for LLM interaction—such as structured outputs, context management, and parallel execution.

2K 6 1
NavodPeiris
grizzlars

High-performance DataFrame library written in C++ with Python bindings.

2K 3 0
ahmadvh
octochains

A lightweight, zero-dependency Python framework for parallel, isolated, collaborative AI reasoning.

1K 336 144
hypergol
hypergol

Hypergol is a Data Science/Machine Learning productivity toolkit to accelerate any projects into production with autogenerated code, standardised structure for data and ML and parallel processing out-of-the-box.

677 53 2
aarjaneiro
parallelqueue

Parallel queueing models for SimPy

539 1 3
trislett
tfce-mediation

Fast regression and mediation analysis of vertex or voxel MRI data with TFCE

537 31 9
usc-isi-i2
pyrallel-lib

Yet another easy-to-use python3 parallel library for humans.

535 13 3
davidenunes
exp

python experiment management toolset

492 16 1
trislett
tmi-viewer

Fast regression and mediation analysis of vertex or voxel MRI data with TFCE

372 31 9
eXascaleInfolab
pyexpool

Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture

249 168 12
hoangthanhlamm
multithread-parallel-processing

Library support parallel processing with multi-thread

247 3 0
kadykov
abopus

Audiobook to Opus converter — efficient batch conversion optimized for voice content

246 2 0
alloc7260
mpfd

A decorator that makes a function into a parallel processor using multithreading.

244 0 0
maximilianpilz
mpunittest

Multi processing for the Python unittest library

216 3 1
nikhiljsk
preprocess-nlp

A fast framework for pre-processing (Cleaning text, Reduction of vocabulary, Feature extraction and Vectorization). Implemented with parallel processing using custom number of processes.

198 10 4
liuzuxin
easy-runner

A lightweight tool for managing and executing multiple parallel experiments.

197 8 1
    • Data from PyPI, GitHub, ClickHouse, and BigQuery