Batching Python Packages

jev-ultralightspeed

BRRRRRRRRRRRRRRRRRRRRRR

batchit

Batch any Python iterator by count, elapsed time, or both. Zero dependencies.

datadog-async-handler

High-performance async HTTP logging handler for Datadog with batching, retry logic, and comprehensive error handling

batchee

NASA Harmony service that groups together files into batches for concatenation

logtide-sdk

Official Python SDK for LogTide - Production-ready logging with automatic batching, circuit breaker, distributed

arekit

Document level Attitude and Relation Extraction toolkit (AREkit) for sampling and processing large text collections with ML and for ML

flushq

A lightweight async batching queue for Python

fast-dynamic-batcher

FastDynamicBatcher is a library for batching inputs across requests to accelerate machine learning workloads

vrambatch

Run batched GPU work inside a VRAM budget, self-healing on CUDA out-of-memory

metabatch

Batch-aware online task creation for meta-learning.

lattice-transport

A complete transport layer for LLM traffic

turbobatch

TurboBatch accelerates transformer inference by up to 10.2x with dynamic batching. It's lightweight, HuggingFace-compatible, and ideal for real-time NLP tasks.