gguf-runner
Local inference platform for K/IQ-quant GGUF models on Apple Silicon
A complete inference runtime for open-weight large language models, enabling efficient execution through streaming weights, quantization, and memory-aware scheduling