llmapi
Optimizing inference proxy for LLMs
Easy-to-use LLM API from state-of-the-art providers and comparison