Pipeline Parallelism Python Packages

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

colossalai

Making large AI models cheaper, faster and more accessible

omniback

Serving Inside Pytorch

colossalai-nightly

Making large AI models cheaper, faster and more accessible

petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

hami-core

Serving Inside Pytorch

hippo-llm

Local LLM inference + embedding & search in one package. Run 30B on consumer hardware, RAG without ChromaDB.

torchgpipe

A GPipe implementation in PyTorch

custom-colossalai

An integrated large-scale model training system with efficient parallelization techniques

fleet-x

飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。

torchslicer

Split learning framework for PyTorch — partition a model across devices and train end-to-end without any single node holding the full model.

elf-pipeline

ELF: PyTorch Framework for Memory-Aware Pipeline Parallel Training

fleet-lightning

No description available

adeepspeed

DeepSpeed library

test-petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

paddle-fleet

飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。