Mixture Of Experts Python Packages

nvidia-cudnn-frontend

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

egobox

Efficient global optimization toolbox in Rust: bayesian optimization, mixture of gaussian processes, sampling methods

smt

SMT: The Surrogate Modeling Toolbox

terradev-cli

An imperative command-line-interface for AI workload orchestration

optillm

Optimizing inference proxy for LLMs

sawyer-core

Distributed MoE inference network — the load is split, friends help.

krasis

Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware

hivemind

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

switch-transformers

Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"

peer-pytorch

Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind

mixture-of-experts

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models

dissenter

A PyPI package implementing a multi-LLM ensemble debate framework. Routes prompts across Claude, GPT, Gemini, Ollama, and any LiteLLM-compatible provider; surfaces disagreements across models and synthesizes a consensus answer.

abliterix

Automated alignment adjustment for LLMs — direct steering, LoRA, and MoE expert-granular abliteration, optimized via multi-objective Optuna TPE.

st-moe-pytorch

Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch

soft-moe-pytorch

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch

mlx-flash

Run AI models too large for your Mac's memory — at near-full speed. Intelligent expert caching, speculative execution, and 15+ research techniques for MoE inference on Apple Silicon.

sinkhorn-router-pytorch

Self contained pytorch implementation of a sinkhorn based router, for mixture of experts or otherwise

pytorch-mixtures

One-stop solutions for Mixture of Expert modules in PyTorch.

mlxlmprobe

Universal probing and interpretability tool for MLX language models on Apple Silicon

mixture-of-attention

Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts

lmxlab

Transformer language models on Apple Silicon with MLX

tracedistill

Distill teacher chains-of-thought into a LoRA adapter via a strict boxed-answer format contract and a two-phase Train→Nudge schedule (silver-medal NVIDIA Nemotron reasoning recipe).

mergoo

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.