Language Detection Python Packages

lingua-language-detector

The most accurate natural language detection library for Python, suitable for short text and mixed-language text

spacy-language-detection

Fully customizable language detection for spaCy pipeline

spark-nlp

State of the Art Natural Language Processing

py3langid

Faster, modernized fork of the language identification tool langid.py

simplemma

Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

pycld3

Python3 bindings for the Compact Language Detector v3 (CLD3)

nlpcloud

NLP Cloud serves high performance pre-trained or custom models for NER, sentiment-analysis, classification, summarization, paraphrasing, intent classification, product description and ad generation, chatbot, grammar and spelling correction, keywords and keyphrases extraction, text generation, image generation, code generation, and more...

spacy-langdetect

A fully customisable language detection pipeline for spaCy

spacy-fastlang

Language detection using Spacy and Fasttext

detectlanguage

Detect Language API Python Client

pyfranc

Text language detection basic on trigrams.

malaya

Natural Language Toolkit for Malaysian language, https://malaya.readthedocs.io/

eld

Fast and accurate natural language detection. Detector written in Python. Nito-ELD, ELD.

pyidaungsu-numpy2

Tiny language detector + tokenizer for 50+ SE/South Asian languages (Burmese, Karen, Chin, Shan, Mon, Khmer, Lao, Thai, Tamil, Hindi, …). Revamp of pyidaungsu.

rosette-api

Babel Street Analytics Client Library for Python

padatious

A neural network intent parser

bytesense

Charset and encoding detection for Python. Identifies the encoding of any byte sequence using byte-distribution fingerprinting, language coherence scoring, and mess detection. Supports streaming detection, mojibake repair, multi-encoding document analysis, and in-band HTML/XML hints. Drop-in replacement for chardet and charset-normalizer.

whatlang-pyo3

Python Binding for Rust WhatLang, a language detection library

eldc

The fastest high-accuracy natural language detector. Written in C.

llmtranslate

A Python library for language detection and translation using langchain ChatModels

glotscript

[LREC 2024] 🖋 Resource and Tool for Writing System Identification

cld2-cffi

Python bindings to the Compact Language Detector

simpleaitranslator

Python library for text translation and language detection using OpenAI's GPT-4o.

pyidaungsu

Tiny language detector + tokenizer for 50+ SE/South Asian languages (Burmese, Karen, Chin, Shan, Mon, Khmer, Lao, Thai, Tamil, Hindi, …). Revamp of pyidaungsu.