Gpt2 Python Packages

bertviz

BertViz: Visualize Attention in Transformer Models

arabert

Pre-trained Transformers for Arabic Language Understanding and Generation (Arabic BERT, Arabic GPT2, Arabic ELECTRA)

bert-seq2seq

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

midigpt

GPT-2 transformer for controllable, multitrack symbolic music generation

glassbox-mech-interp

Open-source EU AI Act Annex IV documentation toolkit. Mechanistic interpretability + circuit discovery for transformers. One function call generates a structured, hash-chained evidence package.

bert-seq2seq-ddp

bert_seq2seq的DDP版本，支持bert、roberta、nezha、t5、gpt2等模型，支持seq2seq、ner、关系抽取等任务，无需添加额外代码，轻松启动DDP多卡训练。

flaxmodels

Pretrained deep learning models for Jax/Flax: StyleGAN2, GPT2, VGG, ResNet, etc.

fennlp

1. Use BERT, ALBERT and GPT2 as tensorflow2.0's layer. 2. Implement GCN, GAN, GIN and GraphSAGE based on message passing.

chattingtransformer

A python package that allows you to generate text with just a few lines of code using GPT2.

expanda

The universal integrated corpus-building environment.

textgen

Text Generation Model

funcbygpt

tell the function what to do and gpt will write the code

lnlp

Last Mile for NLP.

triformer

Transformers components but in Triton

impruver

A set of scripts and configurations for pretraining of Large Language Models (LLM)

code-autocomplete

Code AutoComplete

glassbox-mcp

Open-source EU AI Act Annex IV documentation toolkit. Mechanistic interpretability + circuit discovery for transformers. One function call generates a structured, hash-chained evidence package.

codeassist

Code AutoComplete