gpu-inference
Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware
Mixed-vendor GPU inference cluster manager with speculative decoding
Pythonic LLM inference on legacy GPUs using Vulkan — GPU-accelerated local AI for AMD, Intel, and NVIDIA without CUDA.
