Language Detection Python Packages

lingua-language-detector

The most accurate natural language detection library for Python, suitable for short text and mixed-language text

fasttext-predict

fasttext with wheels and no external dependency, but only the predict method (<1MB)

spark-nlp

State of the Art Natural Language Processing

spacy-language-detection

Fully customizable language detection for spaCy pipeline

py3langid

Faster, modernized fork of the language identification tool langid.py

simplemma

Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

pycld3

Python3 bindings for the Compact Language Detector v3 (CLD3)

spacy-langdetect

A fully customisable language detection pipeline for spaCy

spacy-fastlang

Language detection using Spacy and Fasttext

eldc

The fastest high-accuracy natural language detector. Written in C.

nlpcloud

NLP Cloud serves high performance pre-trained or custom models for NER, sentiment-analysis, classification, summarization, paraphrasing, intent classification, product description and ad generation, chatbot, grammar and spelling correction, keywords and keyphrases extraction, text generation, image generation, code generation, and more...

spacy-cld

Language detection extension for spaCy 2.0+

malaya

Natural Language Toolkit for Malaysian language, https://malaya.readthedocs.io/

glotscript

[LREC 2024] 🖋 Resource and Tool for Writing System Identification

detectlanguage

Detect Language API Python Client

eld

Fast and accurate natural language detection. Detector written in Python. Nito-ELD, ELD.

pico-type

A tiny byte-level multi-head content classifier (~1.5M params, ~200KB ONNX, <6ms). Classifies code, text, markup, config, images, binary, secrets, 62 code languages, 30 text languages, 90 MIME types from raw bytes — no tokenizer needed.

whatlang-pyo3

Python Binding for Rust WhatLang, a language detection library

pyidaungsu-numpy2

Tiny language detector + tokenizer for 50+ SE/South Asian languages (Burmese, Karen, Chin, Shan, Mon, Khmer, Lao, Thai, Tamil, Hindi, …). Revamp of pyidaungsu.

llmtranslate

A Python library for language detection and translation using langchain ChatModels

rosette-api

Babel Street Analytics Client Library for Python

pyfranc

Text language detection basic on trigrams.

padatious

A neural network intent parser

pyidaungsu

Tiny language detector + tokenizer for 50+ SE/South Asian languages (Burmese, Karen, Chin, Shan, Mon, Khmer, Lao, Thai, Tamil, Hindi, …). Revamp of pyidaungsu.