Gpt Python Packages

tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

openhands-ai

🙌 OpenHands: AI-Driven Development

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

e2b

Open-source, secure environment with real-world tools for enterprise-grade agents.

e2b-code-interpreter

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

gptcache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

transformers-stream-generator

This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.

text-generation

Large Language Model Text Generation Inference

promptflow-devkit

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

promptflow-core

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

promptflow-tracing

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

lightrag-hku

[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"

g4f

The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3

e2b-desktop

E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment that you can connect to any LLM for secure computer use.

arxiv-mcp-server

A Model Context Protocol server for searching and analyzing arXiv papers

nixtla

TimeGPT-1: production ready pre-trained Time Series Foundation Model for forecasting and anomaly detection. Generative pretrained transformer for time series trained on over 100B data points. It's capable of accurately predicting various domains such as retail, electricity, finance, and IoT with just a few lines of code 🚀.

promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system

promptflow-tools

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

tensorzero

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

promptflow-azure

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

astrbot

AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨