PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Latency Python Packages

Python packages with the GitHub topic latency. Sorted by relevance, with stars and monthly downloads.
dgzlopes
tcp-latency

Module and command-line tool to measure latency using TCP.

6K 59 14
dropbox
llama

Library for testing and measuring network loss and latency between distributed endpoints.

2K 67 18
net-benchmark
dns-benchmark-tool

deprecated — migrate to net-benchmark. see https://github.com/net-benchmark/net-benchmark

2K 357 10
shredstream
shredstream

Solana ShredStream SDK/Decoder for Python, enabling ultra-low latency Solana transaction streaming via UDP shreds from https://www.shredstream.com

2K 2 0
net-benchmark
net-benchmark

Network benchmarking suite for DNS, HTTP, and SSL — with DNSSEC validation, DoH/DoT support, high‑concurrency testing, and enterprise‑grade reporting.

1K 0 0
RRZE-HPC
osaca

Open Source Architecture Code Analyzer

1K 362 29
4thel00z
percently

A fast and efficient percentile calculator written in Rust.

671 0 0
mirceaulinic
latency-monitor

Lightweight TCP and UDP latency monitoring tool, with pluggable interface for publishing metrics

605 33 1
JordanAllen101
aioprox

Async Python proxy manager with latency testing

599 1 0
Harsh-Daga
lattice-transport

A complete transport layer for LLM traffic

540 0 0
comcast
connmonitor

A persistent monitor and aggregator of network statistics

534 12 2
LatencyGrid
modelping

⚡ Benchmark LLM, STT, and TTS inference latency across providers. Measure TTFT P50/P95/P99, full voice pipeline benchmarks, CI-ready.

437 1 1
stef41
infermark

Benchmark any OpenAI-compatible LLM endpoint. TTFT, inter-token latency, throughput, P50-P99 — in one command.

427 1 0
cezbloch
pytorchures

Measure execution times of every layer in your pytorch model.

405 2 0
theodoreniu
llmperf

Benchmarking tool for stress testing self-hosted LLMs, Azure OpenAI, and OpenAI APIs. Measure latency, throughput, and optimize performance. 🚀

369 4 1
vnmoorthy
pavo-bench

A 50K-turn voice pipeline benchmark and an 85K-param meta-controller that cuts P95 latency 10.3% and energy 71% vs fixed cloud. TMLR 2026.

360 1 0
Samarthuday
voice-budget

The only voice agent context manager with a TTFT feedback loop

336 3 0
dizballanze
do-latency

Digital Ocean latency checker helps to find fastest DO region from your location.

259 114 10
mtli
llcv

An Extensible Framework for Low-Latency Computer Vision Research :fast_forward:

248 6 0
microsoft
nn-meter

A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.

239 365 67
BrunoBonacci
hdr-plot

A simple standalone script to plot HdrHistograms directly from the output of wrk load testing tool

238 22 5
apanchenko
peano

Measures performance and reports to InfluxDB

199 0 0
Bradley-Butcher
splleed

LLM Inference performance harness

156 1 0
nawaz1991
lltune

LLTune tunes Linux servers for ultra-low latency workloads. It scans system state, generates a config, audits for risks, applies safe CPU/ memory/network/kernel/IRQ tuning with backups and rollback, and stages persistence services for reboot.

130 2 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery