gpu-memory-management
Multi-tenant context caching and serving for tabular in-context-learning foundation models (TabICL, TabPFN, and similar)
MEMOPT: Universal Memory Fabric for AI Infrastructure. Open-sourced by Sophisticates.