Ttft Python Packages

benchrig

Cross-platform benchmarking and hardware profiling rig for local LLMs across Ollama, Microsoft Foundry Local, ONNX Runtime GenAI, and Prism on Apple Silicon & CUDA.

llm-autotune

Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and RAM usage by 3x.

ml-systems-lab

Reproducible ML inference benchmarking across heterogeneous hardware: one YAML config drives llama.cpp and ONNX Runtime sweeps on laptops, Raspberry Pi (SSH) and GPUs, with TTFT, throughput, per-rail power, thermal and utilization telemetry in self-describing records, plus publication-quality tables and figures.

infermark

LLM inference benchmarking toolkit. Measure TTFT, inter-token latency, throughput, and P50–P99 across concurrency levels.

voice-budget

The only voice agent context manager with a TTFT feedback loop