Ai Scraping Python Packages

firecrawl-py

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

5.5M 190K 10K

scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

929K 87K 9K

firecrawl

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

716K 190K 10K

spider-client

Python, Javascript, and Rust libraries for the Spider Cloud API.

443K 26 9

abx-dl

⬇️ A simple all-in-one CLI tool to download EVERYTHING from a URL (like youtube-dl/yt-dlp, forum-dl, gallery-dl, simpler ArchiveBox). 🎭 Uses headless Chrome to get HTML, JS, CSS, images/video/audio/subtitles, PDFs, screenshots, article text, git repos, and more...

314K 146 9

web-scraping-api-sdk

Web scraping API examples in Python, Node, Go, Java, PHP, Ruby, cURL and CLI. Proxies, JS rendering, AI extraction, 9 scrapers.

255 2 0

gemini-scraper

Gemini scraper and Gemini API endpoint client in Python and Node. Send prompts, get text, markdown and citations as JSON.

239 0 0

iflow-mcp-d4vinci-scrapling

236 87K 9K

spiderwebai-py

Python, Javascript, and Rust libraries for the Spider Cloud API.

104 26 9

webscrape-ai

The web scraping API that turns any URL into clean data.

67 9 1

markudown

High-performance web scraping engine that converts any web page into clean markdown --- with 3-layer fallback (Cheerio --> Playwright --> Abrasio) and AI-powered structured extraction

60 3 0

scrapling-zhng

50 87K 9K

spidercloud-py

Python, Javascript, and Rust libraries for the Spider Cloud API.

29 26 9

spiderclient-py

Python, Javascript, and Rust libraries for the Spider Cloud API.

27 26 9