Duplicates Python Packages

removedup

Remove duplicates from parallel corpora

immich-photo-manager

📸🧹🗺️ MCP server for intelligent photo management with Immich — search, curate geographic albums, clean up libraries, and publish galleries

deplicate

Advanced Duplicate File Finder for Python

imageduplicatefinder

Software that removes duplicated images from folder2 in respect to folder1

pyunique

Pyunique helps you get rid of duplicate files

arrayhascher

Fast hash in 2D Arrays (Numpy/Pandas/lists/tuples)

a-pandas-ex-duplicates-to-df

Creates a DataFrame/Series from duplicates

uniqdiff

Stable comparison engine for datasets, files, streams, and connector-backed sources.

dropduplicatesplanb

Drops duplicates in DataFrames with tedious dtypes

deplicate-cli

Command Line Interface for deplicate.

thebear

Bear - the decluttering deduplicator

screwduplicates

provides a simple and efficient way to remove duplicates from an iterable (even with unhashable elements, optional order preservation)

drop-duplicates-nested-list

Drops duplicates from nested list

yadupe

Yet another tool to find and remove duplicate files.

duplicateindexer

Find duplicates in multiple lists and return their indices and values.

dupe-eraser

Command-line tools to automate the deletion of duplicates files.

stridesduplicatefinder

Calculate overlapping values between two arrays and return the results as a DataFrame

listset

remove duplicates from lists

searchdups

Search for duplicate files