PyRank

Slurm Python Packages

Python packages with the GitHub topic slurm. Sorted by monthly downloads, with stars and forks.
skypilot-org
skypilot

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

1.3M 11K 1K
facebookincubator
submitit

Python 3.8+ toolbox for submitting jobs to Slurm

1.2M 2K 153
facebookresearch
clusterscope

Clusterscope is a CLI and python library to extract information from HPC Clusters and Jobs.

276K 25 8
pytorch
torchx

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

225K 428 156
basnijholt
slurm-usage

🖥 Command to list the current cluster usage per user

117K 11 5
skypilot-org
skypilot-nightly

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

108K 11K 1K
dstackai
dstack

A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.

79K 2K 269
facebookincubator
hydra-submitit-launcher

Python 3.8+ toolbox for submitting jobs to Slurm

78K 2K 153
meta-pytorch
torchx-nightly

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

58K 427 156
gerlero
foamlib

✨ A modern Python package for interacting with OpenFOAM

23K 231 32
DataBiosphere
toil

A WDL, CWL and Python API supporting easy-to-use workflow engine. It is scalable, efficient and cross-platform (Linux/macOS).

18K 935 246
skypilot-org
trainy-skypilot-nightly

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

17K 11K 1K
pipefunc
pipefunc

Lightweight fast function pipeline (DAG) creation in pure Python for scientific (HPC) workflows 🕸️🧪

13K 482 20
NL-BioImaging
biomero

BIOMERO.analyzer - A python library for easy connecting between OMERO (jobs) and a Slurm cluster

11K 29 6
basnijholt
adaptive-scheduler

Run many functions (adaptively) on many cores (>10k-100k) using mpi4py.futures, ipyparallel, loky, or dask-mpi. :tada:

10K 31 14
pyiron
pysqa

Simple HPC queuing system adapter for Python on based jinja templates to automate the submission script creation.

8K 35 10
saradamian
surf-agentic-base

Run provenance, comparison validity, and the shared primitives for agentic work on research infrastructure. A base layer, not an agent framework.

6K 0 0
pyiron
executorlib

Up-scale python functions for high-performance computing (HPC)

6K 78 9
deepmodeling
dpdispatcher

generate HPC scheduler systems jobs input scripts and submit these scripts to HPC systems and poke until they finish

5K 62 62
ywatanabe1989
scitex-hpc

Generic SLURM dispatch (srun, sbatch, sync, poll, fetch)

4K 0 0
francois-rozet
dawgz

Unleash the true power of scheduling

3K 39 4
ascii-supply-networks
dagster-slurm

Dagster SLURM integration

3K 63 11
SergioZ3R0
nvprobe

nvProbe - Open-source NVIDIA GPU benchmark suite for CUDA workload automation, Slurm HPC cluster profiling, and MLPerf reporting

2K 7 1
canonical
slurmutils

Utilities and APIs for interfacing with the Slurm workload manager ⚙️🔌

2K 6 6