Token Classification Python Packages

adaseq

AdaSeq: An All-in-One Library for Developing State-of-the-Art Sequence Understanding Models

lettucedetect

Lightweight hallucination detection framework for RAG applications

transformers-keras

Transformer-based models implemented in tensorflow 2.x(using keras).

squeakycleantext

Text preprocessing and PII anonymisation for NLP/ML. ONNX NER ensemble, language detection, stopword removal. Built for statistical ML and language models.

rapidnlp-datasets

Data pipelines for both TensorFlow and PyTorch!

ua-datasets

A collection of datasets for Ukrainian language

naivenlp-datasets

Data pipelines for both TensorFlow and PyTorch!

smile-datasets

Data pipelines for both TensorFlow and PyTorch!

factgenie

Lightweight self-hosted span annotation tool

temporal-taggers

Neural temporal taggers with Transformer architectures