PyRank

Model Loading Python Packages

Python packages with the GitHub topic model-loading. Sorted by relevance, with stars and monthly downloads.
lightsofapollo
safetensors-streaming

Stream safetensors files from HTTP/S3 directly to GPU memory

300 0 0
mnisperuza
hcgk-kernel

Hardware Control GateKeeper Kernels for AI inference within frameworks.

164 0 0
lightsofapollo
safetensors-streaming-cu12

CUDA 12 accelerated backend for safetensors-streaming

81 0 0