website-crawler
Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis
Sitesweeper is a python package to help you automate your web scraping process, outputting pages to a file
