webdataset has 2.4M monthly downloads and 3K GitHub stars. Version 1.0.2 supports Python 3.10+, first published in 2020.
It is stably maintained under a permissive license, last released in Jun 2025.
It is built on top of braceexpand, numpy and pyyaml. It is used by 87 tracked packages, including omnivoice, laion-clap and megatron-energon.
GitHub topics include webdataset, webdataset-format and data-augmentation.
Package Insights
- No releases in 231 days despite active commits
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100Weekly Downloads
GitHub Stars
Downloads by OS
Python Versions
Top Countries
Dependencies
45 optional dependencies
- autoflake[dev]
- bandit[dev]
- black[dev]
- build[dev]
- bump2version[dev]
- diffusers[dev]
- flake8[dev]
- icecream[dev]
- imageio[dev]
- isort[dev]
- jupyter[dev]
- jupyterlab[dev]
- lmdb[dev]
- matplotlib[dev]
- mkdocs[dev]
- mkdocs-autorefs[dev]
- mkdocs-jupyter[dev]
- mkdocs-material[dev]
- mkdocs-material-extensions[dev]
- mkdocs-minify-plugin[dev]
- mkdocstrings[dev]
- mkdocstrings-python[dev]
- msgpack[dev]
- mypy[dev]
- nbconvert[dev]
- notebook[dev]
- papermill[dev]
- pdm[dev]
- pillow[dev]
- pre-commit[dev]
- pydocstyle[dev]
- pytest[dev]
- pytest-cov[dev]
- pytorch-lightning[dev]
- ray[dev]
- ruff[dev]
- scipy[dev]
- setuptools[dev]
- torch[dev]
- torchvision[dev]
- transformers[dev]
- twine[dev]
- typer[dev]
- types-pyyaml[dev]
- wheel[dev]
Used By
- omnivoice
- laion-clap
- megatron-energon
- img2dataset
- sapiens-transformers
- dalle2-pytorch
- birder
- clip-retrieval
- fast-whisper-diarizer
- habitat-baselines
- aeiou
- birder-clip
- pytorch-image-translation-models
- atdataset
- unimernet
- krunic
- libauc
- tensorcom
- ichigo-whisper
- atdata
- iara-stt-training
- nemo-export-deploy
- cosmos-predict2
- whisperx-nemo-pipeline
- audyn
- phobos
- caption-flow
- hpsv2x
- seqchromloader
- unlearn-diff
- vision-data-curation
- weatherflow
- geebeam
- speech-text-pipeline
- gst-python-ml
- eval-mm
- ichigo-asr
- cortex-mae
- fluxflow-training
- zoobot
- wsi-patching
- carlib
- iarahealth-stt-training
- zipvoice
- freep2w
- geotiff-tiler
- moviechat
- cvic
- vjepa
- vjepa-encoder