tps
Benchmarking tool for stress testing self-hosted LLMs, Azure OpenAI, and OpenAI APIs. Measure latency, throughput, and optimize performance. 🚀
Measures performance and reports to InfluxDB
