PyRank

Common Crawl Python Packages

Python packages with the GitHub topic common-crawl. Sorted by relevance, with stars and monthly downloads.
MigoXLab
dingo-python

Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool

1K 720 74
4thel00z
ccdown

A polite and user-friendly downloader for Common Crawl data.

559 0 0
KenObata
distributed-curator

Partition-aware MinHash LSH deduplication for large-scale text data curation on Apache Spark

343 1 0
connor-marchand
gau-python

Source: https://github.com/connor-marchand/gau-python

207 3 0
DataEval
dingo-client

Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool

86 718 74