PyRank

Routed Attention Python Packages

Python packages with the GitHub topic routed-attention. Sorted by monthly downloads, with stars and forks.
lucidrains
mixture-of-attention

Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts

329 121 5