PyRank
  • Search
  • PyPI
  • GitHub
  • Insights
  • Compare
  • Advisories
  • Ecosystem
  • About

Streaming Inference Python Packages

Python packages with the GitHub topic streaming-inference. Sorted by monthly downloads, with stars and forks.
paul-krug
pytorch-tcn

(Realtime) Temporal Convolutions in PyTorch

3K 211 17
wpferrell
bigsmall

Lossless AI model compression - ~34% smaller with bit-identical weights; the autopilot profiles your machine, picks the highest fidelity that runs, and streams models bigger than your RAM.

1K 2 0
eulogik
nanoforecast

World's most deployable time series foundation model — 200K-6.5M params, zero-shot forecasting, streaming RNN inference, ONNX edge deployment, runs on Raspberry Pi

92 6 0
flatseek
flatrun

A complete inference runtime for open-weight large language models, enabling efficient execution through streaming weights, quantization, and memory-aware scheduling

83 0 0
Tele-AI
telefuser

High-performance runtime for real-time multimodal generation and world models—streaming inference, stateful sessions, and distributed GPU execution.

69 32 9
    • Original data from PyPI, GitHub, and OSV; downloads served through ClickHouse
    • Sources & methodology