Batch Processing Python Packages

optbinning

Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.

292K 529 116

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

32K 63K 2K

async-batcher

A service to batch the http requests.

12K 37 3

bacalhau-sdk

Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute over Data.

11K 866 100

multidim-indexing

Batch multidimensional indexing for pytorch

11K 8 0

coalestra

Dependency-free async Python library for building consistent, traceable snapshots from multiple read-only sources with caching, batching, single-flight deduplication, retries, circuit breakers, and sync support.

7K 1 0

bacalhau-apiclient

Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute over Data.

2K 866 100

safe-state

Resumable execution for Python. One decorator. Zero retry loops.

2K 0 0

ondine

Batch-process tabular data with any LLM. pandas & Polars in, structured columns out. Checkpointing, budget limits, and 100+ providers built in.

2K 4 2

napari-tmidas

Automated batch processing of cell and tissue microscopy image data in Napari

2K 20 1

batch-img

Batch processing image files by utilizing **Pillow / PIL** library.

2K 0 0

cheminformant

⚗️ An all-in-one solution for chemical property retrieval from PubChem.

2K 50 4

tempren

Template-based file renaming utility

1K 12 3

snapmark

Python library for automated DXF file marking, batch processing, and CAM workflows

1K 2 0

pptx2png

一个将.pptx转换为.png图片的工具集: 包括一个Windows桌面端程序和一个Python库. | A toolkit for converting .pptx files into .png images, including a Windows desktop application and a Python library.

1K 5 0

pixopt

Fast Python image optimizer for the web. Resize, compress, convert formats, generate responsive srcset images, extract lazy-loading placeholders, and detect the optimal format automatically. CLI + library.

1K 0 0

batchling

Save 50% off GenAI costs in two lines of code

1K 22 1

batch-tamarin

A Python package that enables batch execution of tamarin-prover tasks with JSON configuration files and comprehensive reporting.

1K 5 3

textsum

CLI & Python API to easily summarize text-based files with transformers

1K 134 10

nostos

Zero-dependency Python CLI for batch-updating and curating a fleet of git repositories. SQLite metadata index, fail-closed upstream probes (GitHub / GitLab / Gitea), weekly digest, Obsidian bridge.

1K 2 0