Transformers Python Packages

tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

presidio-analyzer

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

ultralytics-thop

PyTorch model profiler for computing MACs and parameter counts to measure deep learning model complexity.

presidio-anonymizer

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

mleap

MLeap: Deploy ML Pipelines to Production

optimum

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

openvino

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

spark-nlp

State of the Art Natural Language Processing

chronos-forecasting

Chronos: Pretrained Models for Time Series Forecasting

curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components

megatron-core

Ongoing research training transformer models at scale

nncf

Neural Network Compression Framework for enhanced OpenVINO™ inference

auto-round

A simple and effective post training quantization toolkit for high-accuracy low-bit LLM inference|简洁且高效的后训练量化工具包

segmentation-models-pytorch

Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.

bertopic

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

mlx-audio

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

argostranslate

Open-source offline translation library written in Python

swanlab

⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.

llm-guard

The Security Toolkit for LLM Interactions

adaptive-classifier

A flexible, adaptive classification system for dynamic text classification

presidio-image-redactor

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

presidio-structured

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence