Pretrained Language Model Python Packages

torchscale

Foundation Architecture for (M)LLMs

cehrbert

CEHR-BERT: Incorporating temporal information from structured EHR data to improve prediction tasks

opendelta

A plug-and-play library for parameter-efficient-tuning (Delta Tuning)

mwptoolkit

MWPToolkit is an open-source framework for math word problem(MWP) solvers.

timeagi

The official code for "TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting (ICLR 2024)". TEMPO is one of the very first open source Time Series Foundation Models for forecasting task v1.0 version.

torchscale-gml

Foundation Architecture for (M)LLMs