inference-acceleration
[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.
TurboDiffusion: 100–200× Acceleration for Video Diffusion Models
⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.
