Text Generation Python Packages

transformers-stream-generator

This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.

clarifai

Experience the power of Clarifai’s AI platform with the python SDK. 🌟 Star to support our work!

llmx

An API for Chat Fine-Tuned Large Language Models (llm)

vector-vault

Customize ChatGPT and unleash the full potential of generative AI with Vector Vault

mauve-text

Package to compute Mauve, a similarity score between neural text and human text. Install with `pip install mauve-text`.

gpt-2-simple

Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts

nlpcloud

NLP Cloud serves high performance pre-trained or custom models for NER, sentiment-analysis, classification, summarization, paraphrasing, intent classification, product description and ad generation, chatbot, grammar and spelling correction, keywords and keyphrases extraction, text generation, image generation, code generation, and more...

webscout

LLM4Free — All-in-one Python toolkit for web search, AI interaction (40+ free providers), digital utilities, and more. Formerly WebScout.

easy-llama

Python package wrapping llama.cpp for on-device LLM inference

docler

Abstractions & Tools for OCR / document processing

tfkit

🤖📇 handling multiple nlp task in one pipeline

amrlib

A python library that makes AMR parsing, generation and visualization simple.

steadytext

Deterministic text generation and embeddings with zero configuration

novelai-python

✨ NovelAI api python sdk, easy to use, modern and user-friendly.

russian-names

Library for generation of russian names

llm4free

LLM4Free — All-in-one Python toolkit for web search, AI interaction (40+ free providers), digital utilities, and more. Formerly WebScout.

gpt2-client

✍🏻 gpt2-client: Easy-to-use TensorFlow Wrapper for GPT-2 117M, 345M, 774M, and 1.5B Transformer Models 🤖 📝

wordsmith-engine

Composable, deterministic-friendly text-generation components for Python

texar-pytorch

Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/

gpt3-simple-primer

Simplifying GPT-3 priming.

kan-gpt

The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling

perchance

Unofficial Python API for Perchance.

llm-venice

LLM plugin to access models available via the Venice API

textpolicy

Reinforcement learning for text generation on MLX (Apple Silicon)