scrapfly
Official Python SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Integrates with Scrapy, LlamaIndex, and LangChain.
Scrapy downloader middleware for Proxlane: one gateway in front of your scraping APIs, with failover and honest outcomes