Pipeline Framework Python Packages

mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

pipefunc

Lightweight fast function pipeline (DAG) creation in pure Python for scientific (HPC) workflows 🕸️🧪

combo

(AAAI' 20) A Python Toolbox for Machine Learning Model Combination

mediapipe-model-maker

Cross-platform, customizable ML solutions for live and streaming media.

mediapipe-nightly

Cross-platform, customizable ML solutions for live and streaming media.

gokart

Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.

pipen

A pipeline framework for python

pyppl

A pipeline framework for python

pipen-filters

Add a set of useful filters for pipen templates

torchline

Easy to use Pytorch

py-turbo

Pyturbo package: A pipeline system for efficient concurrent execution

lightflow

A lightweight, distributed workflow system

surround

Surround is a framework for building AI driven microservices in Python, https://surround.readthedocs.io/en/latest/

steppy-toolkit

Curated set of transformers that make your work with steppy faster and more effective :telescope:

vent

Vent is a light-weight platform built to automate network collection and analysis pipelines using a flexible set of popular open source tools and technologies. Vent is python-based, extensible, leverages docker containers, and provides both an API and CLI.

amqpipe

Twisted based pipeline framework for AMQP

pycompss

COMP Superscalar (COMPSs) is a framework which aims to ease the development and execution of applications for distributed infrastructures, such as Clusters, Grids and Clouds.

streamlined

Make ML or generic pipeline more streamlined

informatics

Framework of fast implementation data processing and operating pipelines

pipen-diagram

Draw pipeline diagrams for pipen.

smartpipeline

A framework for rapid development of robust data pipelines following a simple design pattern

pipeless-ai

An open-source computer vision framework to create and deploy computer vision applications that scale in minutes

neuraxle

The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right pipeline abstractions to write clean deep learning production pipelines. Let your pipeline steps have hyperparameter spaces. Design steps in your pipeline like components. Compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks and MLOps environments.

pipeless-ai-tf-models

An open-source computer vision framework to build and deploy apps in minutes