Workflow Management Python Packages

hera

Hera makes Python code easy to orchestrate on Argo Workflows through native Python integrations. It lets you construct and submit your Workflows entirely in Python. ⭐️ Remember to star!

doit

CLI task management & automation tool

snakemake

This is the development home of the workflow management system Snakemake. For general information, see

dirac

DIRAC Grid

hera-workflows

Hera makes Python code easy to orchestrate on Argo Workflows through native Python integrations. It lets you construct and submit your Workflows entirely in Python. ⭐️ Remember to star!

cylc-flow

Cylc: a general purpose workflow engine with a gift for cycling

datajoint

Relational Workflows: where database schemas define executable data pipelines.

diraccommon

DIRAC Grid

calkit-python

That's a nice result you got there, but how did you calculate it?

pyiron-base

Core components of the pyiron integrated development environment (IDE) for computational materials science

proxystore

Advanced data flow management for distributed Python applications

covalent

Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

stimela

Containerized radio interferometry scripting framework -- NB: Classic version is no longer in active development, use stimela 2! See README for details.

calk9

That's a nice result you got there, but how did you calculate it?

cova

Covalent Workflow Tool

checklistfabrik

ChecklistFabrik is a Python 3 tool to simplify and automate process management using HTML checklists backed by YAML files.

iotaa

It's One Thing After Another: A Simple Workflow Engine

buildpy

A workflow engine in Python

junban

Junban (順番) – Simple Sequential Python Workflows

ilus

A lightweight and handy variant calling pipeline generator for whole-genome sequencing (WGS) and whole exom sequencing data (WES) analysis by using GATK and Sentieon. 一个基于 GATK 和 Sentieon 的简易且全面的 WGS/WES 分析流程生成器.

selinon

An advanced distributed task flow management on top of Celery

n8n-deploy

Python CLI tool for n8n workflow deployment and management. Uses local SQLite database, supports remote deployment of n8n workflows without web UI. Features minimalist setup, backup/restore, n8n API key management, and flexible configuration.

gird

Make-like build tool & task runner for Python

wmcoredb

WMCore database schema used for WMAgent