PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Streaming Inference Python Packages

Python packages with the GitHub topic streaming-inference. Sorted by relevance, with stars and monthly downloads.
paul-krug
pytorch-tcn

(Realtime) Temporal Convolutions in PyTorch

6K 203 17
wpferrell
bigsmall

Lossless AI model compression - ~34% smaller with bit-identical weights; the autopilot profiles your machine, picks the highest fidelity that runs, and streams models bigger than your RAM.

3K 1 0
eulogik
nanoforecast

World's most deployable time series foundation model — 200K-6.5M params, zero-shot forecasting, streaming RNN inference, ONNX edge deployment, runs on Raspberry Pi

427 1 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery