datasets has 132.7M monthly downloads and 22K GitHub stars. Version 5.0.0 supports Python 3.10.0+, first published in 2015.
It is actively maintained under a permissive license, last released in Jun 2026.
It is built on top of dill, filelock and fsspec. It is used by 2,447 tracked packages, including sglang, swebench and mini-swe-agent.
GitHub topics include nlp, datasets and pytorch.
Package Insights
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100Weekly Downloads
GitHub Stars
Downloads by OS
Python Versions
Top Countries
Dependencies
- dill <0.4.2,>=0.3.0
- filelock
- fsspec <=2026.4.0,>=2023.1.0
- httpx <1.0.0
- huggingface-hub <2.0,>=0.25.0
- multiprocess <0.70.20
- numpy >=1.17
- packaging
- pandas
- pyarrow >=21.0.0
- pyyaml >=5.1
- requests >=2.32.2
- tqdm >=4.66.3
- xxhash
124 optional dependencies
- absl-py[tests-numpy2]
- absl-py[tests]
- absl-py[dev]
- aiohttp[dev]
- aiohttp[tests]
- aiohttp[tests-numpy2]
- decorator[tests]
- decorator[tests-numpy2]
- decorator[dev]
- elasticsearch[tests-numpy2]
- elasticsearch[dev]
- elasticsearch[tests]
- faiss-cpu[tests]
- faiss-cpu[dev]
- h5py[tests-numpy2]
- h5py[tests]
- h5py[dev]
- ipyniivue[nibabel]
- jax[jax]
- jax[tests-numpy2]
- jax[tests]
- jax[dev]
- jaxlib[tests-numpy2]
- jaxlib[tests]
- jaxlib[jax]
- jaxlib[dev]
- joblib[tests-numpy2]
- joblib[tests]
- joblib[dev]
- joblibspark[tests-numpy2]
- joblibspark[dev]
- joblibspark[tests]
- lz4[tests]
- lz4[tests-numpy2]
- lz4[dev]
- moto[tests-numpy2]
- moto[dev]
- moto[tests]
- nibabel[tests]
- nibabel[tests-numpy2]
- nibabel[nibabel]
- nibabel[dev]
- numba[tests]
- numba[tests-numpy2]
- numba[dev]
- pdfplumber[pdfs]
- pillow[tests]
- pillow[tests-numpy2]
- pillow[vision]
- pillow[dev]
- polars[dev]
- polars[tests]
- polars[tests-numpy2]
- protobuf[tests]
- protobuf[dev]
- protobuf[tests-numpy2]
- py7zr[tests]
- py7zr[tests-numpy2]
- py7zr[dev]
- pyiceberg[dev]
- pyiceberg[iceberg]
- pyiceberg[tests]
- pyiceberg[tests-numpy2]
- pylance[tests-numpy2]
- pylance[dev]
- pylance[tests]
- pyspark[tests]
- pyspark[dev]
- pyspark[tests-numpy2]
- pytest[dev]
- pytest[tests]
- pytest[tests-numpy2]
- pytest-datadir[dev]
- pytest-datadir[tests]
- pytest-datadir[tests-numpy2]
- pytest-xdist[tests]
- pytest-xdist[tests-numpy2]
- pytest-xdist[dev]
- rarfile[tests-numpy2]
- rarfile[tests]
- rarfile[dev]
- ruff[quality]
- ruff[dev]
- sqlalchemy[tests-numpy2]
- sqlalchemy[dev]
- sqlalchemy[tests]
- teich[tests-numpy2]
- teich[tests]
- teich[dev]
- tensorflow[docs]
- tensorflow[tensorflow]
- tensorflow[tensorflow-gpu]
- tensorflow[tests]
- tensorflow[benchmarks]
- tensorflow[dev]
- tiktoken[dev]
- tiktoken[tests]
- tiktoken[tests-numpy2]
- torch[docs]
- torch[tests]
- torch[tests-numpy2]
- torch[torch]
- torch[audio]
- torch[benchmarks]
- torch[dev]
- torchcodec[tests-numpy2]
- torchcodec[audio]
- torchcodec[dev]
- torchcodec[tests]
- torchdata[tests]
- torchdata[dev]
- torchdata[tests-numpy2]
- transformers[benchmarks]
- transformers[dev]
- transformers[docs]
- transformers[tests]
- transformers[tests-numpy2]
- trimesh[mesh]
- trimesh[tests]
- trimesh[tests-numpy2]
- trimesh[dev]
- zstandard[dev]
- zstandard[tests]
- zstandard[tests-numpy2]
Used By
- sglang
- swebench
- mini-swe-agent
- trl
- mteb
- unsloth
- lm-eval
- ragas
- unsloth-zoo
- verifiers
- mlx-vlm
- llamafactory
- pyspark-huggingface
- flagembedding
- ossdata
- inspect-evals
- torchtune
- aiperf
- argilla
- lerobot
- colbert-ai
- setfit
- tinker-cookbook
- llmcompressor
- fev
- pyiqa
- google-tunix
- unitxt
- sae-lens
- opendsstar
- ragworkbench
- pytdc
- dreadnode
- f5-tts
- ms-swift
- pyrit
- torchtitan
- voxcpm
- transformer-lens
- verl
- textattack
- reward-kit
- auto-round
- garak
- simpletransformers
- auto-gptq
- gantry
- control-arena
- pyserini
- autoawq