PyRank

Prompt Lookup Decoding Python Packages

Python packages with the GitHub topic prompt-lookup-decoding. Sorted by monthly downloads, with stars and forks.
icnatspell
dejavuu

Training-free speculative decoding for ONNX Runtime and Hugging Face PyTorch models

135 1 0