PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

On Device Llm Python Packages

Python packages with the GitHub topic on-device-llm. Sorted by relevance, with stars and monthly downloads.
google-ai-edge
litert-lm-builder

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

55K 6K 615
google-ai-edge
litert-lm-api

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

22K 6K 615
google-ai-edge
litert-lm

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

19K 6K 615
google-ai-edge
litert-lm-builder-nightly

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

8K 6K 615
google-ai-edge
litert-lm-api-nightly

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

4K 6K 615
google-ai-edge
litert-lm-nightly

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

3K 6K 615
amareshhebbar
truenorth-framework

Declare the outcome, skip the logic. The developer-first infrastructure engine for structured, multi-turn AI conversations with built-in safety, async follow-ups, and native compliance

999 25 0
google-ai-edge
litert-lm-cli-nightly

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

286 6K 615
    • Data from PyPI, GitHub, ClickHouse, and BigQuery