Token Classification Python Packages

adaseq

AdaSeq: An All-in-One Library for Developing State-of-the-Art Sequence Understanding Models

lettucedetect

Lightweight hallucination detection framework for RAG applications

transformers-keras

Transformer-based models implemented in tensorflow 2.x(using keras).

squeakycleantext

Text preprocessing & PII anonymization pipeline for NLP/ML: ONNX NER ensemble, language detection, stopword removal, and configurable token replacement.

rapidnlp-datasets

Data pipelines for both TensorFlow and PyTorch!

ua-datasets

A collection of datasets for Ukrainian language

naivenlp-datasets

Data pipelines for both TensorFlow and PyTorch!

smile-datasets

Data pipelines for both TensorFlow and PyTorch!

factgenie

Lightweight self-hosted span annotation tool

temporal-taggers

Code and data form the paper BERT Got a Date: Introducing Transformers to Temporal Tagging