Speech Python Packages

datasets

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

torchaudio

Data manipulation and transformation for audio signal processing, powered by PyTorch

modelscope

ModelScope: bring the notion of Model-as-a-Service to life.

silero-vad

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

gtts

Python library and CLI tool to interface with Google Translate's text-to-speech API

whisperx

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

hume

Python client for Hume AI

whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

monotonic-alignment-search

Monotonically align text and speech

voxcpm

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

tts

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

penn

Pitch Estimating Neural Networks (PENN)

deepfilternet

Noise supression using deep filtering

pypar

Phoneme alignment representation compatible with multiple forced aligners

supertonic

Lightning-Fast, On-Device TTS — running natively via ONNX.

pyfoal

Python forced alignment

emphases

Crowdsourced and Automatic Speech Prominence Estimation

pysptk

A python wrapper for Speech Signal Processing Toolkit (SPTK).

silero

Silero Models: pre-trained text-to-speech models made embarrassingly simple

nkululeko

Machine learning speaker characteristics

achatbot

An open source chat bot architecture for voice/vision (and multimodal) assistants, local(CPU/GPU bound) and remote(I/O bound) to run.

clearvoice

An AI-Powered Speech Processing Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Enhancement, Separation, and Target Speaker Extraction, etc.

abstractvoice

Modular Python voice I/O for AI applications. Text-to-speech, speech-to-text, and voice cloning with local-first defaults and remote provider support. One interface across Piper, Supertonic, OpenAI, OmniVoice, and more.

silero-vad-lite

Lightweight wrapper for Silero VAD using internal ONNX Runtime and with no python package dependencies