Latency Python Packages

tcp-latency

Module and command-line tool to measure latency using TCP.

llama

Library for testing and measuring network loss and latency between distributed endpoints.

dns-benchmark-tool

Network benchmarking suite for DNS, HTTP, and SSL — with DNSSEC validation, DoH/DoT support, high‑concurrency testing, and enterprise‑grade reporting

percently

⚡️ Blazing-fast percentile calculator (p50/p95/p99) in Rust — with Python bindings

osaca

Open Source Architecture Code Analyzer

net-benchmark

Network benchmarking suite for DNS, HTTP, and SSL — with DNSSEC validation, DoH/DoT support, high‑concurrency testing, and enterprise‑grade reporting

aioprox

Async Python proxy manager with latency testing

shredstream

Solana ShredStream SDK for Python — PyO3 bindings to the Rust core, ultra-low latency UDP shred streaming.

modelping

⚡ Benchmark LLM, STT, and TTS inference latency across providers. Measure TTFT P50/P95/P99, full voice pipeline benchmarks, CI-ready.

llmperf

Benchmarking tool for stress testing self-hosted LLMs, Azure OpenAI, and OpenAI APIs. Measure latency, throughput, and optimize performance. 🚀

connmonitor

Uses the connvitals library to continuously poll and record network connectivity statistics.

latency-monitor

Daemon that acts as both client & server for monitoring latency between different endpoints

pytorchures

Python profiler for pytorch models. Wraps each layer and measures it's execution time.

nn-meter

A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.

voice-budget

The only voice agent context manager with a TTFT feedback loop

hdr-plot

A simple HdrHistogram plotting script.

do-latency

🐳 Digital Ocean regions latency checker

infermark

Benchmark any OpenAI-compatible LLM endpoint. TTFT, inter-token latency, throughput, P50-P99 — in one command.

lattice-transport

A complete transport layer for LLM traffic

llcv

An Extensible Framework for Low-Latency Computer Vision Research :fast_forward:

splleed

LLM inference benchmarking harness with pluggable backends

lltune

LLTune tunes Linux servers for ultra-low latency workloads. It scans system state, generates a config, audits for risks, applies safe CPU/ memory/network/kernel/IRQ tuning with backups and rollback, and stages persistence services for reboot.

peano

Measures python performance and reports to InfluxDB

pavo-bench

PAVO-Bench: 50K-turn voice pipeline benchmark and 85K-param meta-controller for ASR->LLM->TTS routing.