Pretrained Language Model Python Packages

torchscale

Foundation Architecture for (M)LLMs

cehrbert

CEHR-BERT: Incorporating temporal information from structured EHR data to improve prediction tasks

opendelta

An open source framework for delta learning (parameter efficient learning).

torchscale-gml

Foundation Architecture for (M)LLMs

mwptoolkit

No description available

timeagi

The official code for "TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting (ICLR 2024)". TEMPO is one of the very first open source Time Series Foundation Models for forecasting task v1.0 version.