PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Open Source Llm Python Packages

Python packages with the GitHub topic open-source-llm. Sorted by relevance, with stars and monthly downloads.
bentoml
openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

11K 12K 811
bentoml
openllm-core

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

4K 12K 811
bentoml
openllm-client

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

2K 12K 811
Kenza-AI
sagify

LLMs and Machine Learning done easily

775 443 68
sandy-sp
gittxt

Gittxt is an AI-focused CLI and plugin tool for extracting, filtering, and packaging text from GitHub repos. Build LLM-compatible datasets, prep code for prompt engineering, and power AI workflows with structured .txt, .json, .md, or .zip outputs.

442 0 1
Talnz007
vulkan-ilm

GPU-accelerated LLaMA inference wrapper for legacy Vulkan-capable systems a Pythonic way to run AI with knowledge (Ilm) on fire (Vulkan).

90 32 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery