Data Extraction Python Packages

firecrawl-py

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

5.5M 190K 10K

flashtext

Extract Keywords from sentence or Replace keywords in sentences.

2.4M 6K 596

stagehand

The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.

1.4M 26K 2K

crawl4ai

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

1.3M 86K 9K

scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

929K 87K 9K

firecrawl

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

716K 190K 10K

amazoncaptcha

Pure Python, lightweight, Pillow-based solver for Amazon's text captcha.

246K 493 90

scrapfly-sdk

Official Python SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Integrates with Scrapy, LlamaIndex, and LangChain.

246K 62 17

apify

Apify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Built on top of the the Apify API Client.

204K 180 29

kreuzberg

Kreuzberg v4 LTS — long-term support for the v4 line (legacy; superseded by xberg for v5+). MIT-licensed.

201K 17 4

openccu-data

Data-extraction pipeline and source-of-truth distribution for Homematic CCU configuration metadata — parses OCCU/RaspberryMatic TCL & JS into compact, typed JSON artifacts (easymodes, translations, profiles).

195K 0 0

pdf-oxide

The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry leaders, 100% pass rate on 3,830 PDFs. MIT/Apache-2.0.

171K 1K 135

stagehand-py

The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.

88K 26K 2K

recipe-scrapers

Python package for scraping recipes data

79K 2K 677

socid-extractor

⛏️ The extraction engine behind Maigret: turn any profile URL into a structured OSINT record across 150+ sites

79K 1K 123

office-oxide

The fastest Office document library for Python, Rust, Go, JS/TS, C# and WASM. DOCX, XLSX, PPTX, DOC, XLS, PPT. Up to 100× faster than python-docx/openpyxl/python-pptx. 100% pass rate on valid Office files. MIT/Apache-2.0.

46K 149 22