Ggml Python Packages

gguf

LLM inference in C/C++

crispasr

C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B v2, etc, plus universal forced alignment, and more

cyllama

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

transcribe-cpp-native

ggml speech-to-text inference for 16+ model families

cyllama-vulkan

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

cyllama-cuda12

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

transcribe-cpp

ggml speech-to-text inference for 16+ model families

cyllama-rocm

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

cyllama-sycl

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

stable-diffusion-cpp-python

stable-diffusion.cpp bindings for python

clip-cpp

CLIP inference in plain C/C++ with no extra dependencies

gguf-inspect

A from-scratch GGUF parser and CLI inspector — stdlib only, no dependencies. pip install gguf-inspect

transcribe-cpp-native-cu12

ggml speech-to-text inference for 16+ model families

grammatica

GBNF (GGML BNF) grammar builder that exposes the GBNF notation system using a syntax that reflects the resulting grammar.

pyllama-server

LLM inference in C/C++