cpu-optimization
High-performance C++17 KV cache compression engine for LLM inference with Python bindings, SIMD acceleration, and multi-backend support.
Actually-sparse dynamic training for PyTorch. CPU-native, Apple Silicon first. Pluggable routers, drop-in SparseLinear.
NovaNN, A high-performance deep learning ecosystem with strong CPU & GPU acceleration.