Mixture Of Models Python Packages

switch-transformers

Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"

vllm-sr-sim

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

vllm-semantic-router-bench

Comprehensive benchmark suite for semantic router vs direct vLLM evaluation across multiple reasoning datasets

mixturelib

mixture lib, python package