Web Data Extraction Python Packages

firecrawl-py

The API to search, scrape, and interact with the web at scale. 🔥

7.2M 144K 8K

firecrawl

The API to search, scrape, and interact with the web at scale. 🔥

1.3M 144K 8K

diffbot-python

Python client library for Diffbot APIs

889 124 39

qcrawl

qcrawl - fast async web crawling & scraping framework for Python.

834 110 6

proxywhirl

rotating proxy system

438 22 7

markudown

High-performance web scraping engine that converts any web page into clean markdown --- with 3-layer fallback (Cheerio --> Playwright --> Abrasio) and AI-powered structured extraction

147 3 0

lightfeed-sdk

Lightfeed SDK for Python

116 6 1