PyRank
  • Search
  • PyPI
  • GitHub
  • Insights
  • Compare
  • Advisories
  • Ecosystem
  • About

Llm Gateway System Python Packages

Python packages with the GitHub topic llm-gateway-system. Sorted by monthly downloads, with stars and forks.
radlab-dev-group
radlab-llm-router

LLM Router is a service that can be deployed on‑premises or in the cloud. It adds a layer between any application and the LLM provider. In real time it controls traffic, distributes a load among providers of a specific LLM, and enables analysis of outgoing requests from a security perspective (masking, anonymization, prohibited content).

4K 15 4
520atp
hengroute

OpenAI 兼容的 AI 大模型网关:一个 API Key 调用所有大模型,智能路由降本,实时可观测,故障自动降级。

296 2 0
520atp
hengroute-cli

OpenAI 兼容的 AI 大模型网关:一个 API Key 调用所有大模型,智能路由降本,实时可观测,故障自动降级。

283 2 0
    • Original data from PyPI, GitHub, and OSV; downloads served through ClickHouse
    • Sources & methodology