Speech Python Packages

datasets

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

torchaudio

Data manipulation and transformation for audio signal processing, powered by PyTorch

modelscope

ModelScope: bring the notion of Model-as-a-Service to life.

gtts

Python library and CLI tool to interface with Google Translate's text-to-speech API

whisperx

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

silero-vad

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

tts

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

monotonic-alignment-search

Monotonically align text and speech

silero

Silero Models: pre-trained text-to-speech models made embarrassingly simple

voxcpm

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

hume

Python client for Hume AI

deepfilternet

Noise supression using deep filtering

supertonic

Lightning-Fast, On-Device TTS — running natively via ONNX.

penn

Pitch Estimating Neural Networks (PENN)

achatbot

An open source chat bot architecture for voice/vision (and multimodal) assistants, local(CPU/GPU bound) and remote(I/O bound) to run.

pysptk

A python wrapper for Speech Signal Processing Toolkit (SPTK).

senselab

senselab is a Python package that simplifies building pipelines for biometric (e.g. speech, voice, video, etc) analysis.

inaspeechsegmenter

CNN-based audio segmentation toolkit. Allows to detect speech, music, noise and speaker gender. Has been designed for large scale gender equality studies based on speech time per gender.

clearvoice

An AI-Powered Speech Processing Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Enhancement, Separation, and Target Speaker Extraction, etc.

aeneas

aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)

allosaurus

Allosaurus is a pretrained universal phone recognizer for more than 2000 languages

nlp

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

sinapsis

Modular and Universal AI platform