PyRank

Onnxruntime Genai Python Packages

Python packages with the GitHub topic onnxruntime-genai. Sorted by monthly downloads, with stars and forks.
senssei
benchrig

Cross-platform benchmarking and hardware profiling rig for local LLMs across Ollama, Microsoft Foundry Local, ONNX Runtime GenAI, and Prism on Apple Silicon & CUDA.

893 0 0
senssei
prism-local

Multi-engine local AI CLI and OpenAI-compatible server (ONNX Runtime GenAI + Ollama) for Linux and WSL2

872 0 0