PyRank
  • Search
  • PyPI
  • GitHub
  • Insights
  • Compare
  • Advisories
  • Ecosystem
  • About

Webarchive Data Scraping Python Packages

Python packages with the GitHub topic webarchive-data-scraping. Sorted by monthly downloads, with stars and forks.
q-m
scrapy-webarchive

A plugin for Scrapy that allows users to capture and export web archives in the WARC and WACZ formats during crawling.

245 9 1
ariedotcodotnz
wayback-machine-downloader

Python port of wayback-machine-downloader for downloading archived websites from the Internet Archive Wayback Machine, with extra fixes, improvements, and a Python-friendly CLI.

228 3 0
    • Original data from PyPI, GitHub, and OSV; downloads served through ClickHouse
    • Sources & methodology