Data Loader Python Packages

torchtext

Models, data loaders and abstractions for language processing, powered by PyTorch

vitrio

High throughput Cryo-EM image I/O library for Python

xml2db

A Python package to load complex XML files into a relational database

dali-rp2

DaLI (Data Loader Interface) is a data loader and input generator for RP2 (https://pypi.org/project/rp2), the privacy-focused, free, open-source cryptocurrency tax calculator: DaLI removes the need to manually prepare RP2 input files. Just like RP2, DaLI is also free, open-source and it prioritizes user privacy.

zephon

Fast, flexible, elastically deterministic data loading for foundation model training

audiomate

Python library for handling audio datasets.

activeft

PyTorch library for Active Fine-Tuning

thelper

Training framework & tools for PyTorch-based machine learning projects.

climata

Python library for loading and iterating over climate and flow time series data (from ACIS/NOAA RCCs, CoCoRaHS, Hydromet/USBR, CNRFC ESP/NWS, SNOTEL/AWDB/NRCS, and NWIS/USGS)

benzina

Benzina is an image-loader package that greatly accelerates image loading onto GPUs using their built-in hardware codecs.

wxpath

wxpath - declarative web crawling with XPath; a Web Query Language (WQL)

vibe-trading-livetennis

A Vibe-Trading data loader for tennis event-market price series (Polymarket, public + keyless), with optional Live Tennis API live-state enrichment. Observe-only.

torchfsdd

A utility for wrapping the Free Spoken Digit Dataset into PyTorch-ready data set splits.

spltr

`Spltr` is a simple PyTorch-based data loader and splitter. It may be used to load arrays and matrices or Pandas DataFrames and CSV files containing numerical data with subsequent split it into train, test (validation) subsets in the form of PyTorch DataLoader objects.

nra

🧬 The 21st Century Data Format for AI. CDC deduplication, Zero-Download cloud streaming, O(1) random access. Built in Rust.