Dask Python Packages

narwhals

Lightweight and extensible compatibility layer between dataframe libraries!

dask

Parallel computing with task scheduling

xarray

N-D labeled arrays and datasets in Python

distributed

A distributed task scheduler for Dask

swifter

A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner

datacompy

Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!

fugue

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

array-api-compat

Compatibility layer for common array libraries to support the Array API

fugue-sql-antlr

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

autoray

Abstract your array operations.

numpydantic

Type annotations for specifying, validating, and serializing arrays with arbitrary backends in Pydantic (and beyond)

stumpy

STUMPY is a powerful and scalable Python library for modern time series analysis

mlforecast

Scalable machine 🤖 learning for time series forecasting.

xgboost-ray

Distributed XGBoost on Ray

libcudf-cu12

cuDF - GPU DataFrame Library

flox

Fast & furious GroupBy operations for dask.array

pylibcudf-cu12

cuDF - GPU DataFrame Library

cudf-cu12

cuDF - GPU DataFrame Library

dask-awkward

Native Dask collection for awkward arrays, and the library to use it.

dask-histogram

Histograms with task scheduling.

dask-cudf-cu12

cuDF - GPU DataFrame Library

traceml

Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

pyresample

Geospatial image resampling in Python

datatile

Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.