ngrok-server
LocalLab: A lightweight AI inference server for running LLMs locally or in Google Colab with a friendly API.
LocalLab allows you to easily run Hugging Face AI models locally or on Google Colab, featuring automatic API setup, model management, performance optimization, and system monitoring.
