PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Pipelines Python Packages

Python packages with the GitHub topic pipelines. Sorted by relevance, with stars and monthly downloads.
pytorch
torchx

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

346K 423 152
meltano
meltano

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

279K 3K 238
pepkit
pipestat

Pipeline results reporting package

126K 4 2
meta-pytorch
torchx-nightly

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

97K 423 152
zenml-io
zenml

ZenML πŸ™: One AI Platform from Pipelines to Agents. https://zenml.io.

89K 5K 617
mage-ai
mage-ai

πŸ§™ Build, run, and manage data pipelines for integrating and transforming data.

67K 9K 965
polyaxon
polyaxon

MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle

36K 4K 325
pipefunc
pipefunc

Lightweight fast function pipeline (DAG) creation in pure Python for scientific (HPC) workflows πŸ•ΈοΈπŸ§ͺ

31K 463 19
elyra-ai
kfp-notebook

Elyra extends JupyterLab with an AI centric approach.

30K 2K 365
pypyr
pypyr

pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.

26K 644 30
mmourafiq
vents

Open source connections catalog, integrations, tools, alerting, and notifications library.

23K 31 4
Avaiga
taipy

Turns Data and AI algorithms into production-ready web applications in no time.

18K 19K 2K
anam-org
metaxy

Pluggable sample-level metadata versioning for incremental multimodal pipelines.

18K 97 6
ASEM000
pytreeclass

Visualize, create, and operate on pytrees in the most intuitive way possible.

15K 46 2
joocer
data-expectations

Are your data meeting your expectations?

14K 1 1
MLBazaar
mlprimitives

Primitives for machine learning and data science.

14K 70 37
zenml-io
zenml-nightly

ZenML πŸ™: One AI Platform from Pipelines to Agents. https://zenml.io.

13K 5K 617
calkit
calkit-python

That's a nice result you got there, but how did you calculate it?

13K 44 7
ploomber
ploomber

The fastest ⚑️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️

13K 4K 241
mabel-dev
mabel

😊 mabel is a platform for authoring data processing systems.

13K 7 3
tenzir
tenzir

Tenzir CLI bindings and binary launchers

12K 737 102
Avaiga
taipy-gui

Turns Data and AI algorithms into production-ready web applications in no time.

11K 19K 2K
4dn-dcic
tibanna

Tibanna helps you run your genomic pipelines on Amazon cloud (AWS). It is used by the 4DN DCIC (4D Nucleome Data Coordination and Integration Center) to process data. Tibanna supports CWL/WDL (w/ docker), Snakemake (w/ conda) and custom Docker/shell command.

11K 72 28
lsst
lsst-pipe-base

LSST Data Management: base classes for data processing tasks

11K 12 11
    • Data from PyPI, GitHub, ClickHouse, and BigQuery