Locality Sensitive Hashing Python Packages

datasketch

MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW

annoy

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

elastiknn-client

Elasticsearch plugin for nearest neighbor search. Store vectors and run similarity search using exact and approximate algorithms.

annoy-mm

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

gaoya

Locality Sensitive Hashing

pari-similarity

Similarity indexing and deduplication for large datasets, with Rust, Python, and CLI interfaces.

akin

Python library for detecting near duplicate texts in a corpus at scale.

lshashing

python library to perform Locality-Sensitive Hashing for faster nearest neighbors search in high dimensional data

websieve

Turn a web crawl into an ML-ready dataset. Boilerplate extraction, Gopher/C4 quality filtering, MinHash near-dedup, sharded output. Zero dependencies.

aghasher

An implementation of Anchor Graph Hashing (Liu et al. 2011) in Python.

lshrs

Locality Sensitive Hashing (LSH) based recommendation system. Integrates with Redis and your own database.

lshashpy3

locality sensitive hashing (LSHASH) for Python3

annoy-binary

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

mashing-pumpkins

Minhash and maxhash library in Python, combining flexibility, expressivity, and performance.

annoy-fixed

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

annoy-dm

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

simple-lsh

fast and simple locality-sensitive hashing implemented in (numba + numpy)