Pretrained Language Model Python Packages

torchscale

Foundation Architecture for (M)LLMs

cehrbert

CEHR-BERT: Incorporating temporal information from structured EHR data to improve prediction tasks

opendelta

A plug-and-play library for parameter-efficient-tuning (Delta Tuning)

torchscale-gml

Foundation Architecture for (M)LLMs

mwptoolkit

No description available

timeagi

Time Series Foundation Model - TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting