Ray Python Packages

awswrangler

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

wandb-osh

A convenient way to trigger synchronizations to wandb / Weights & Biases if your compute nodes don't have internet!

torchx

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

torchx-nightly

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

dagster-ray

Ray integration for Dagster

raydp

RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.

horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

ant-ray-cpp-nightly

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

ray-cpp

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

kubetorch

Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.

runhouse

Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.

pymars

Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.

lance-ray

Integration between Lance and Ray for distributed data processing

pyluxcore

LuxCore source repository

ant-ray-nightly

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

daft-lts

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

unidist

Unified Distributed Execution

omniback

Serving Inside Pytorch

terradev-cli

NUMA-aware GPU provisioning and orchestration for stateless MoE workloads of all sizes

ant-ray

Ray provides a simple, universal API for building distributed applications.

ado-core

A framework for designing, executing and analysing experiment campaigns

raydp-nightly

RayDP: Distributed Data Processing on Ray