Speech Python Packages

datasets

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

torchaudio

Data manipulation and transformation for audio signal processing, powered by PyTorch

modelscope

ModelScope: bring the notion of Model-as-a-Service to life.

gtts

Python library and CLI tool to interface with Google Translate's text-to-speech API

silero-vad

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

whisperx

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

silero

Silero Models: pre-trained text-to-speech models made embarrassingly simple

tts

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

monotonic-alignment-search

Monotonically align text and speech

whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

voxcpm

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

hume

Python client for Hume AI

deepfilternet

Noise supression using deep filtering

supertonic

Lightning-Fast, On-Device TTS — running natively via ONNX.

penn

Pitch Estimating Neural Networks (PENN)

pysptk

A python wrapper for Speech Signal Processing Toolkit (SPTK).

achatbot

An open source chat bot architecture for voice/vision (and multimodal) assistants, local(CPU/GPU bound) and remote(I/O bound) to run.

allosaurus

Allosaurus is a pretrained universal phone recognizer for more than 2000 languages

inaspeechsegmenter

CNN-based audio segmentation toolkit. Allows to detect speech, music, noise and speaker gender. Has been designed for large scale gender equality studies based on speech time per gender.

nkululeko

Machine learning speaker characteristics

clearvoice

An AI-Powered Speech Processing Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Enhancement, Separation, and Target Speaker Extraction, etc.

nlp

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

africanwhisper

🚀 Framework for seamless fine-tuning of Whisper model on a multi-lingual dataset and deployment to prod.

aeneas

aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)