Large Language Model Python Packages

pocketflow

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

multilspy

multilspy is a lsp client library in Python intended to be used to build applications around language servers.

atomic-agents

Building AI agents, atomically

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

streaming-json-parser

Streaming JSON parser designed to process JSON data incrementally. The primary goal is to handle potentially incomplete JSON data streams, such as those produced by Large Language Models (LLMs), and return the current state of the parsed object at any time.

badam

[NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models

uralicnlp

An NLP library for Uralic languages such as Finnish, Skolt Sami, Moksha and so on. Also supporting some non-Uralic languages such as Spanish, French, Arabic, Swedish, Norwegian, Russian and English. LLMs, FSTs and More!

bintensors

Binary tensor format for more efficient storage format for multi-dimensional tensor data, commonly used in machine learning and deep learning applications.

gpt-multi-atomic-agents

A simple dynamic multi-agent framework based on atomic-agents, Instructor and Pydantic.

novelai-python

✨ NovelAI api python sdk, easy to use, modern and user-friendly.

picollm

On-device LLM Inference Powered by X-Bit Quantization

picollmdemo

On-device LLM Inference Powered by X-Bit Quantization

elscirl

The core repository of the elsciRL framework.

llmgraph

Create knowledge graphs with LLMs

nvim-mcp

MCP server that connects AI agents to your running Neovim instance via msgpack-RPC — no plugins required.

nerif

LLM powered Python

eegunity

An open source tool for large-scale EEG datasets processing

openai-batch

Make OpenAI batch easy to use.

pfd-toolkit

Analyse Prevention of Future Death (PFD) reports with AI

clearflow

Correctness-first orchestration for emergent AI. Type-safe, deeply immutable, 100% code coverage.

sagify

Machine Learning Training, Tuning and Deployment on AWS

minillmflow

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

autocode-py

Auto Code Improvements by Metrics Optimization.