PyRank
  • Search
  • PyPI
  • GitHub
  • Insights
  • Compare
  • Advisories
  • Ecosystem
  • About

Offline Inference Python Packages

Python packages with the GitHub topic offline-inference. Sorted by monthly downloads, with stars and forks.
yzfly
edgejev

离线可用的本地类型化决策:4 核 CPU 单题 15.6ms。Local & offline Jev / System One inference on CPU — ONNX + INT8, no torch at runtime. 支持 laya / kev / PlayJev

3K 21 2
bmw8080
laya-decision-api

把本地 System-1 决策模型(Laya)包成 HTTP 服务:意图分类 / 工单分派 / LLM 路由 / 内容审核,离线零 token、不生成文字;Apple Silicon(MLX) 与 Linux(torch) 双后端;可导出 OpenAPI 3.0/3.1;Java/TS/Python 零依赖 SDK。

788 1 0
    • Original data from PyPI, GitHub, and OSV; downloads served through ClickHouse
    • Sources & methodology