Large Language Model Python Packages

multilspy

multilspy is a lsp client library in Python intended to be used to build applications around language servers.

pocketflow

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

atomic-agents

Building AI agents, atomically

streaming-json-parser

Streaming JSON parser designed to process JSON data incrementally. The primary goal is to handle potentially incomplete JSON data streams, such as those produced by Large Language Models (LLMs), and return the current state of the parsed object at any time.

intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

novelai-python

NovelAI Python Binding With Pydantic

uralicnlp

An NLP library for Uralic languages such as Finnish, Skolt Sami, Moksha and so on. Also supporting some non-Uralic languages such as Spanish, French, Arabic, Swedish, Norwegian, Russian and English. LLMs, FSTs and More!

bintensors

Another file format for storing your models in a binary encoded format.

nvim-mcp

MCP server for AI-assisted control of Neovim via msgpack-RPC

llmgraph

Create knowledge graphs with LLMs

badam

[NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models

picollm

On-device LLM Inference Powered by X-Bit Quantization

gpt-multi-atomic-agents

A simple dynamic multi-agent framework based on atomic-agents, Instructor and Pydantic.

arcshiftwrap

Python client for the Arctic Shift API.

elscirl

The core repository of the elsciRL framework.

picollmdemo

On-device LLM Inference Powered by X-Bit Quantization

eegunity

An open source tool for large-scale EEG datasets processing

openai-batch

Make OpenAI batch easy to use.

sagify

LLMs and Machine Learning done easily

nerif

LLM powered Python

clearflow

Correctness-first orchestration for emergent AI. Type-safe, deeply immutable, 100% code coverage.

framescope

End-to-end pipeline for collecting, labeling, and analyzing metaphor framing and stance in Reddit and news discourse using LLMs.

sec-summary-llm

packages extracts structured summaries from security and government texts using LLM