Commoncrawl Python Packages

news-please

news-please - an integrated web crawler and information extractor for news that just works

cdx-toolkit

A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine

fundus

A very simple news crawler with a funny name

ghostpath

👻 GhostPath — A powerful modular reconnaissance toolkit built for hackers, OSINT professionals & bug bounty hunters — passive + active recon in a sleek CLI shell. Discover subdomains, probe paths, mine archives and hunt certificates — all from one interactive terminal interface.

tardir

Migrated to: https://codeberg.org/openculinary/tardir