parameter-streaming
PyTorch compiler and Rust runtime for multi-CPU/GPU inference, NUMA-aware scheduling, model serving, parameter streaming, and activation spill.