Gpt Python Packages

tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

e2b

Open-source, secure environment with real-world tools for enterprise-grade agents.

e2b-code-interpreter

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

openhands-ai

🙌 OpenHands: AI-Driven Development

promptflow-devkit

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

promptflow-core

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

promptflow-tracing

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

gptcache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

transformers-stream-generator

This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.

llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

lightrag-hku

[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"

vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

g4f

The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3

promptflow-tools

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

text-generation

Large Language Model Text Generation Inference

nixtla

TimeGPT-1: production ready pre-trained Time Series Foundation Model for forecasting and anomaly detection. Generative pretrained transformer for time series trained on over 100B data points. It's capable of accurately predicting various domains such as retail, electricity, finance, and IoT with just a few lines of code 🚀.

arxiv-mcp-server

A Model Context Protocol server for searching and analyzing arXiv papers

e2b-desktop

E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment that you can connect to any LLM for secure computer use.

tensorzero

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

promptflow-azure

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system

metagpt

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming