scaper
Convert web content to Markdown & JSON files to fuel your GPTs !
Web spiders are usually disliked by websites, but useful for recursive API/page downloads for offline analysis.
