PyRank
  • Search
  • PyPI
  • GitHub
  • Insights
  • Compare
  • Advisories
  • Ecosystem
  • About

Batch Inference Python Packages

Python packages with the GitHub topic batch-inference. Sorted by monthly downloads, with stars and forks.
AliOsm
cohere-transcribe

Production-ready batch inference for Cohere’s Arabic/English ASR model, with optimized Silero VAD, multi-file GPU batching, subtitles, and optional word-level timestamps.

424 19 3
kotwal-itpro
steadybatch

Run millions of LLM requests through batch APIs (OpenAI, Gemini, Anthropic, vLLM) without silent failures. Plus an open benchmark of batch inference services.

264 0 0
AliOsm
cohere-transcribe-arabic

Production-ready batch inference for Cohere’s Arabic/English ASR model, with optimized Silero VAD, multi-file GPU batching, subtitles, and optional word-level timestamps.

113 19 3
    • Original data from PyPI, GitHub, and OSV; downloads served through ClickHouse
    • Sources & methodology