PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Dedup Python Packages

Python packages with the GitHub topic dedup. Sorted by relevance, with stars and monthly downloads.
jamjamjon
ilytix

A CLI tool for images analysis: checking image integrity, images deduplication, image retrieval.

576 4 0
xyb
chunkdup

Find (partial content) duplicate files.

442 3 1
markusressel
py-image-dedup

A library to find duplicate images and delete unwanted ones

422 170 18
corbenicai
merlin-langchain

Merlin Community Edition — free dedup engine + integrations. Saves LLM tokens. No telemetry.

366 3 0
xyb
chunksum

Print FastCDC rolling hash chunks and checksums.

349 2 0
laktak
chkbit

Check your files for data corruption and run quick file deduplication

298 176 13
yugn
yadupe

Yet another tool to find and remove duplicate files.

133 0 1
    • Data from PyPI, GitHub, ClickHouse, and BigQuery