airllm
Run 70B+ LLMs on a single 4GB GPU — no quantization required.
Run OpenClaw on a local model. Zero API cost. One OpenAI-compatible endpoint over Ollama, llama.cpp, vLLM or LM Studio — plus AirLLM for models bigger than your GPU.