Large Language Model Python Packages

multilspy

multilspy is a lsp client library in Python intended to be used to build applications around language servers.

pocketflow

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

atomic-agents

Building AI agents, atomically

streaming-json-parser

Python JSON decoding with strict incremental parsing, NDJSON, and selective extraction.

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

bintensors

Binary tensor format for more efficient storage format for multi-dimensional tensor data, commonly used in machine learning and deep learning applications.

intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

novelai-python

✨ NovelAI api python sdk, easy to use, modern and user-friendly.

uralicnlp

An NLP library for Uralic languages such as Finnish, Skolt Sami, Moksha and so on. Also supporting some non-Uralic languages such as Spanish, French, Arabic, Swedish, Norwegian, Russian and English. LLMs, FSTs and More!

nvim-mcp

MCP server that connects AI agents to your running Neovim instance via msgpack-RPC — no plugins required.

elscirl

The core repository of the elsciRL framework.

sagify

LLMs and Machine Learning done easily

gpt-multi-atomic-agents

A simple dynamic multi-agent framework based on atomic-agents, Instructor and Pydantic.

picollm

On-device LLM Inference Powered by X-Bit Quantization

openai-batch

Make OpenAI batch easy to use.

clearflow

Correctness-first orchestration for emergent AI. Type-safe, deeply immutable, 100% code coverage.

picollmdemo

On-device LLM Inference Powered by X-Bit Quantization

nerif

LLM-powered Python

llmgraph

Create knowledge graphs with LLMs

badam

[NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models

autocode-py

Auto Code Improvements by Metrics Optimization.

agent-function-tool

Universal wrapper for Python functions to be used with LLM function calling

minillmflow

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

tiny-llm-course

learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen