PyRank

Tensor Parallelism Python Packages

Python packages with the GitHub topic tensor-parallelism. Sorted by relevance, with stars and monthly downloads.
bigscience-workshop
petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

1K 10K 621
KaiyuYue
torchshard

Slicing a PyTorch Tensor Into Parallel Shards

470 300 15
bigscience-workshop
test-petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

123 10K 621