Ray Python Packages

awswrangler

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

torchx

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

wandb-osh

A convenient way to trigger synchronizations to wandb / Weights & Biases if your compute nodes don't have internet!

dagster-ray

Ray integration for Dagster

torchx-nightly

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

lance-ray

Integration between Lance and Ray for distributed data processing

horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

ray-cpp

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

ant-ray-cpp-nightly

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

pymars

Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.

raydp

RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.

pyluxcore

LuxCore source repository

daft-lts

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

unidist

Unified Distributed Execution

nucore

The interaction primitive.

nustd

The interaction primitive.

ant-ray-nightly

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

nucli

The interaction primitive.

ado-core

A framework for designing, executing and analysing experiment campaigns

dagster-slurm

Dagster SLURM integration

ado-vllm-performance

A framework for designing, executing and analysing experiment campaigns

runhouse

Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.