Dataset Python Packages

faker

Faker is a Python package that generates fake data for you.

tensorflow-io-gcs-filesystem

Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO

stringzilla

Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops 🦖

tensorflow-datasets

TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...

pytest-cases

Separate test code from test cases in pytest.

ir-datasets

Provides a common interface to many IR ranking datasets.

pandas-datareader

Extract data from a wide range of Internet sources into a pandas DataFrame.

mosaicml-streaming

A Data Streaming Library for Efficient Neural Network Training

colour-science

Colour Science for Python

tensorflow-io

Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO

torchtext

Models, data loaders and abstractions for language processing, powered by PyTorch

fastdownload

Easily download, verify, and extract archives

quandl

Package for quandl API access

cpi

Quickly adjust U.S. dollars for inflation using the Consumer Price Index (CPI)

scipp

Multi-dimensional data arrays with labeled dimensions

video2dataset

Easily create large video dataset from video urls

cvat-sdk

Computer Vision Annotation Tool (CVAT) is a leading platform for building high-quality visual datasets for vision AI. It offers open-source, cloud, and enterprise products, as well as labeling services, for image, video, and 3D annotation with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs.

label-studio

Label Studio is a multi-type data labeling and annotation tool with standardized output format

tfds-nightly

TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...

torchxrayvision

TorchXRayVision: A library of chest X-ray datasets and models. Classifiers, segmentation, and autoencoders.

fake-factory

Faker is a Python package that generates fake data for you.

datalad

Keep code, data, containers under control with git and git-annex

tensorflow-io-nightly

Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO

neuspell

NeuSpell: A Neural Spelling Correction Toolkit