Roberta Python Packages

curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components

adaptive-classifier

A flexible, adaptive classification system for dynamic text classification

loralib

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

news-please

news-please - an integrated web crawler and information extractor for news that just works

bertviz

BertViz: Visualize Attention in Transformer Models

farm

:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

happytransformer

Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.

texar-pytorch

Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/

ernie

Simple State-of-the-Art BERT-Based Sentence Classification with Keras / TensorFlow 2. Built with HuggingFace's Transformers.

embedding-as-service

One-Stop Solution to encode sentence to fixed length vectors from various embedding techniques

bert-seq2seq

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

adamix-gpt2

This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.12410).

belt-nlp

BERT classification model for processing texts longer than 512 tokens. Text is first divided into smaller chunks and after feeding them to BERT, intermediate results are pooled. The implementation allows fine-tuning.

bert-seq2seq-ddp

bert_seq2seq的DDP版本，支持bert、roberta、nezha、t5、gpt2等模型，支持seq2seq、ner、关系抽取等任务，无需添加额外代码，轻松启动DDP多卡训练。

langformers

🚀 Unified NLP Pipelines for Language Models

deberta

The implementation of DeBERTa

fastc

Unattended Lightweight Text Classifiers with LLM Embeddings

smaberta

Wrapper for stable version of RoBERTa language models

embedding-as-service-client

One-Stop Solution to encode sentence to fixed length vectors from various embedding techniques

nlp-lmd

Language Model Decomposition: Quantifying the Dependency and Correlation of Language Models

sam-lora-lib

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"