Slurm Python Packages

submitit

Python 3.8+ toolbox for submitting jobs to Slurm

2.6M 2K 148

skypilot

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

1.8M 10K 1K

clusterscope

Clusterscope is a CLI and python library to extract information from HPC Clusters and Jobs.

1.1M 24 5

skypilot-nightly

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

407K 10K 1K

torchx

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

346K 423 152

dstack

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

124K 2K 228

hydra-submitit-launcher

Python 3.8+ toolbox for submitting jobs to Slurm

100K 2K 148

torchx-nightly

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

97K 423 152

slurm-usage

🖥 Command to list the current cluster usage per user

55K 11 4

pipefunc

Lightweight fast function pipeline (DAG) creation in pure Python for scientific (HPC) workflows 🕸️🧪

31K 463 19

toil

A WDL, CWL and Python API supporting easy-to-use workflow engine. It is scalable, efficient and cross-platform (Linux/macOS).

28K 930 246

foamlib

✨ A modern Python package for interacting with OpenFOAM

26K 202 27

trainy-skypilot-nightly

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

17K 10K 1K

executorlib

Up-scale python functions for high-performance computing (HPC)

14K 73 6

pysqa

Simple HPC queuing system adapter for Python on based jinja templates to automate the submission script creation.

12K 34 8

adaptive-scheduler

Run many functions (adaptively) on many cores (>10k-100k) using mpi4py.futures, ipyparallel, loky, or dask-mpi. :tada:

12K 30 14

pympipool

Up-scale python functions for high-performance computing (HPC)

8K 73 6

arvak

Rust-native quantum compilation stack with CUDA-Q, IQM, IBM Quantum & QDMI backends. Deep framework interop with Qiskit, Cirq, Qrisp & PennyLane. First-class SLURM/PBS and European HPC support.

6K 1 0