PyRank

Llama Cpp Alternative Python Packages

Python packages with the GitHub topic llama-cpp-alternative. Sorted by relevance, with stars and monthly downloads.
brontoguana
krasis

Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware

3K 452 26