Pipeline Framework Python Packages

mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

2.1M 37K 6K

combo

(AAAI' 20) A Python Toolbox for Machine Learning Model Combination

61K 660 105

pipefunc

Lightweight fast function pipeline (DAG) creation in pure Python for scientific (HPC) workflows 🕸️🧪

13K 482 20

mediapipe-nightly

Cross-platform, customizable ML solutions for live and streaming media.

11K 37K 6K

gokart

Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.

9K 342 63

pipen

A pipeline framework for python

5K 112 15

ubunye-engine

Config-driven Spark framework for data and ML pipelines. Describe a pipeline once as config plus Python, then run that exact folder on a laptop, Docker, Kubernetes, cloud clusters or Databricks.

2K 17 1

mediapipe-model-maker

Cross-platform, customizable ML solutions for live and streaming media.

1K 37K 6K

steppy-toolkit

Curated set of transformers that make your work with steppy faster and more effective :telescope:

1K 23 9

pipen-filters

Add a set of useful filters for pipen templates.

1K 3 0

py-turbo

Pyturbo package: A pipeline system for efficient concurrent execution

978 29 2

pyppl

A pipeline framework for python

727 112 15

informatics

Framework of fast implementation data processing and operating pipelines

655 585 17

pipen-diagram

Draw pipeline diagrams for pipen.

635 5 0

pycompss

COMP Superscalar (COMPSs) is a framework which aims to ease the development and execution of applications for distributed infrastructures, such as Clusters, Grids and Clouds.

607 65 24

vent

Vent is a light-weight platform built to automate network collection and analysis pipelines using a flexible set of popular open source tools and technologies. Vent is python-based, extensible, leverages docker containers, and provides both an API and CLI.

550 78 34

lightflow

A lightweight, distributed workflow system

462 111 19

streamlined

Making running scripts more streamlined!

421 0 0

neuraxle

The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right pipeline abstractions to write clean deep learning production pipelines. Let your pipeline steps have hyperparameter spaces. Design steps in your pipeline like components. Compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks and MLOps environments.

413 612 62