PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Dataloader Python Packages

Python packages with the GitHub topic dataloader. Sorted by relevance, with stars and monthly downloads.
surister
conecta

SQL to Arrow made easy.

11K 5 0
janelia-cellmap
cellmap-data

Utility for loading CellMap data for machine learning training, utilizing PyTorch, TensorStore, Xarray, and PyDantic.

5K 8 3
birkhoffg
jax-dataloader

Pytorch-like dataloaders for JAX.

3K 103 4
Continvvm
continuum

A clean and simple data loading library for Continual Learning

3K 447 44
photoroom
datago

A natively parallel dataloader for Python, written in Rust. Serving data at GB/s speeds, while covering aspect ratio bucketing, crop and resize for image ML workloads.

3K 128 7
jkobject
scdataloader

a dataloader to work with large single cell datasets from lamindb

3K 40 7
IRVLUTD
fewsoldataloader

Pytorch Dataloader for FewSOL

1K 2 0
bendangnuksung
dynabatch

PyTorch/Hugging Face batching utility that sorts variable-length text by difficulty, then dynamically increases batch size on easier samples using a pre-trained VRAM predictor to improve GPU utilization and throughput while reducing OOM risk with fallback handling.

1K 1 0
cobanov
bucketsampler

Aspect ratio bucketing for diffusion training. PyTorch native, DDP correct, no training-framework lock-in.

983 2 0
dvm-shlee
bruker

A modular toolkit for Bruker MRI raw-data handling.

867 56 30
torchvtk
torchvtk

PyTorch volume toolkit. Efficient data loading, dataset conversions, visualization tools

787 10 2
fal-ai
lavender-data

Load & manage evolving datasets efficiently

685 23 0
srpraneeth
torch-dataloader-utils

Efficient Data Loader Utils for loading data from structured sources into Pytorch

638 0 0
willGuimont
torch-waymo

PyTorch dataloader for Waymo Open Dataset

575 18 4
nzx9
vdataset

Load video datasets to PyTorch DataLoader. (Custom Video Data set for PyTorch DataLoader)

521 0 0
zensors
datatap

Focus on Algorithm Design, Not on Data Wrangling

512 34 3
unum-cloud
ukv

Multi-Modal Database replacing MongoDB, Neo4J, and Elastic with 1 faster ACID solution, with NetworkX and Pandas interfaces, and bindings for C 99, C++ 17, Python 3, Java, GoLang 🗄️

459 632 35
DBraun
audiotree

Audio data loading and augmentations in JAX

346 5 1
SerezD
ffcv-pl

[FFCV-PL] manage fast data loading with ffcv and pytorch lightning

345 16 0
inikishev
light-dataloader

Much faster dataloader for datasets that are fully loaded into memory

282 3 0
rodrigobdz
lrp-pf-auc

Explain Neural Networks using Layer-Wise Relevance Propagation and evaluate the explanations using Pixel-Flipping and Area Under the Curve.

254 17 1
redhottensors
hydrax

A zero-copy multiprocess dataloader for Jax.

204 1 0
oinopion
dloader

DataLoader implementation for Python asyncio

201 0 0
syfun
async-dataloader

Asyncio Dataloader for GraphQL.

177 6 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery