Dask Python Packages

narwhals

Lightweight and extensible compatibility layer between dataframe libraries!

dask

Parallel computing with task scheduling

swifter

A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner

xarray

N-D labeled arrays and datasets in Python

distributed

A distributed task scheduler for Dask

datacompy

Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!

array-api-compat

Compatibility layer for common array libraries to support the Array API

fugue

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

numpydantic

Type annotations for specifying, validating, and serializing arrays with arbitrary backends in Pydantic (and beyond)

autoray

Abstract your array operations.

mlforecast

Scalable machine 🤖 learning for time series forecasting.

stumpy

STUMPY is a powerful and scalable Python library for modern time series analysis

libcudf-cu12

cuDF - GPU DataFrame Library

cudf-cu12

cuDF - GPU DataFrame Library

pylibcudf-cu12

cuDF - GPU DataFrame Library

xgboost-ray

Distributed XGBoost on Ray

fugue-sql-antlr

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

sqlalchemy-cratedb

SQLAlchemy dialect for CrateDB.

flox

Fast & furious GroupBy operations for dask.array

dask-awkward

Native Dask collection for awkward arrays, and the library to use it.

traceml

Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

dask-histogram

Histograms with task scheduling.

datatile

Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

pandas-summary

Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.