PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Ggml Python Packages

Python packages with the GitHub topic ggml. Sorted by relevance, with stars and monthly downloads.
ggml-org
gguf

LLM inference in C/C++

6.5M 111K 18K
xorbitsai
xinference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

41K 9K 824
shakfu
cyllama

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

22K 25 20
shakfu
cyllama-cuda12

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

16K 25 20
shakfu
cyllama-vulkan

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

15K 25 20
shakfu
cyllama-sycl

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

12K 25 20
shakfu
cyllama-rocm

A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp

10K 25 20
william-murray1204
stable-diffusion-cpp-python

stable-diffusion.cpp bindings for python

3K 113 16
monatis
clip-cpp

CLIP inference with no big dependencies such as PyTorch, TensorFlow, Numpy or ONNX

2K 557 53
LexicHQ
smartloop

AI orchestration on your device

673 4 0
ggml-org
pyllama-server

LLM inference in C/C++

210 111K 18K
yaphott
grammatica

GBNF (GGML BNF) grammar builder that exposes the GBNF notation system using a syntax that reflects the resulting grammar.

136 3 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery