Dask Python Packages

narwhals

Lightweight and extensible compatibility layer between dataframe libraries!

dask

Parallel computing with task scheduling

xarray

N-D labeled arrays and datasets in Python

distributed

A distributed task scheduler for Dask

swifter

A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner

datacompy

Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!

fugue

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

array-api-compat

Compatibility layer for common array libraries to support the Array API

fugue-sql-antlr

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

xgboost-ray

Distributed XGBoost on Ray

mlforecast

Scalable machine 🤖 learning for time series forecasting.

autoray

Abstract your array operations.

stumpy

STUMPY is a powerful and scalable Python library for modern time series analysis

numpydantic

Type annotations for specifying, validating, and serializing arrays with arbitrary backends in Pydantic (and beyond)

flox

Fast & furious GroupBy operations for dask.array

dask-cloudprovider

Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...

pylibcudf-cu12

cuDF - GPU DataFrame Library

libcudf-cu12

cuDF - GPU DataFrame Library

cudf-cu12

cuDF - GPU DataFrame Library

traceml

Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

pandas-summary

Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

datatile

Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

pyresample

Geospatial image resampling in Python

dask-cudf-cu12

cuDF - GPU DataFrame Library