PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Large Language Model Python Packages

Python packages with the GitHub topic large-language-model. Sorted by relevance, with stars and monthly downloads.
microsoft
multilspy

multilspy is a lsp client library in Python intended to be used to build applications around language servers.

44K 574 105
The-Pocket
pocketflow

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

27K 11K 1K
BrainBlend-AI
atomic-agents

Building AI agents, atomically

24K 6K 511
aramisfacchinetti
streaming-json-parser

Streaming JSON parser designed to process JSON data incrementally. The primary goal is to handle potentially incomplete JSON data streams, such as those produced by Large Language Models (LLMs), and return the current state of the parsed object at any time.

9K 13 2
intel
intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

5K 2K 217
open-compass
opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

4K 7K 779
LlmKira
novelai-python

NovelAI Python Binding With Pydantic

2K 45 2
mikahama
uralicnlp

An NLP library for Uralic languages such as Finnish, Skolt Sami, Moksha and so on. Also supporting some non-Uralic languages such as Spanish, French, Arabic, Swedish, Norwegian, Russian and English. LLMs, FSTs and More!

2K 96 7
GnosisFoundation
bintensors

Another file format for storing your models in a binary encoded format.

2K 4 1
paulburgess1357
nvim-mcp

MCP server for AI-assisted control of Neovim via msgpack-RPC

2K 53 3
dylanhogg
llmgraph

Create knowledge graphs with LLMs

2K 508 31
Ledzy
badam

[NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models

1K 287 14
Picovoice
picollm

On-device LLM Inference Powered by X-Bit Quantization

1K 312 25
mrseanryan
gpt-multi-atomic-agents

A simple dynamic multi-agent framework based on atomic-agents, Instructor and Pydantic.

1K 7 1
sagnik-chakravarty
arcshiftwrap

Python client for the Arctic Shift API.

1K 1 0
pdfosborne
elscirl

The core repository of the elsciRL framework.

941 18 0
Picovoice
picollmdemo

On-device LLM Inference Powered by X-Bit Quantization

921 312 25
Baizhige
eegunity

An open source tool for large-scale EEG datasets processing

832 56 4
parasail-ai
openai-batch

Make OpenAI batch easy to use.

793 8 1
Kenza-AI
sagify

LLMs and Machine Learning done easily

775 443 68
Nerif-AI
nerif

LLM powered Python

752 15 5
artificial-sapience
clearflow

Correctness-first orchestration for emergent AI. Type-safe, deeply immutable, 100% code coverage.

687 0 1
sagnik-chakravarty
framescope

End-to-end pipeline for collecting, labeling, and analyzing metaphor framing and stance in Reddit and news discourse using LLMs.

684 1 0
chigwell
sec-summary-llm

packages extracts structured summaries from security and government texts using LLM

613 1 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery