Mixture Of Models Python Packages

switch-transformers

Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"

vllm-sr-sim

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

vllm-semantic-router-bench

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

mixturelib

The implementation of mixtures for different tasks.