mixture-of-depths
Hardware-aligned latent deliberation framework decoupling System 2 continuous reasoning from System 1 autoregressive decoding.
One-stop solutions for Mixture of Expert modules in PyTorch.
