Scraping Api Python Packages

serpapi

Official Python wrapper for SerpApi HTTP endpoints

scrapfly-sdk

Official Python SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Integrates with Scrapy, LlamaIndex, and LangChain.

context-dev

Context.dev Python SDK: scrape any URL to LLM-ready markdown, crawl sites, search the web and extract structured JSON with one API key.

crw

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

langchain-scrapegraph

ScrapeGraph client langchain integration

crawlora

Python SDK for the public Crawlora API.

crawlora-flashscore

Flashscore API clients for JavaScript/TypeScript, Python, Go, Ruby, Java and PHP: scores, match details, competitions, teams, players, odds and news. Official Crawlora SDKs for its hosted Flashscore data API.

crawlora-sofascore

SofaScore API clients for JavaScript/TypeScript, Python, Go, Ruby, Java and PHP: live events, match details, lineups, statistics, tournaments and player/team data. Official Crawlora SDKs for its hosted SofaScore data API.

crawlora-fotmob

FotMob API clients for JavaScript/TypeScript, Python, Go, Ruby, Java and PHP: leagues, matches, fixtures, teams, players, search, standings, news and rankings. Official Crawlora SDKs for its hosted FotMob data API.

crawlora-youtube

YouTube API clients for JavaScript/TypeScript, Python, Go, Ruby, Java and PHP: search, channels, videos, playlists, comments, captions and transcripts. Official Crawlora SDKs for its hosted YouTube data API.

jirosearch

Jiro Search: Open-source, self-hosted search API with 9 engines, 12 social scrapers, MCP server, hybrid search & AI synthesis. Free SerpAPI alternative. MIT licensed. pip install jirosearch

crawlbase

Fast python library for the Crawlbase API

crawlora-bbb

Better Business Bureau (BBB) API clients for JavaScript/TypeScript, Python, Go, Ruby, Java and PHP: business search, profiles, complaints, reviews, categories and ScamTracker reports. Official Crawlora SDKs for its hosted Better Business Bureau data API.

captchatools

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha, Anticaptcha, and Capsolver API's!

fastcrawl

Official Fastcrawl Python SDK — fastcrawl on PyPI. Scrape, crawl, map, search, extract, batch, parse, screenshot, PDF, usage for AI agents.

x402-agent-gateway

Pay-per-call APIs for AI agents, settled in USDC over x402. Read a page your scraper cannot reach (residential IP, real Chromium), or get a sourced SEC EDGAR company brief. No account, no API key, free quote.

yandex-reverse-image-api

Yandex reverse image search API in Python and Node: source pages, similar images, products and OCR via ScrapingBee.

crawlora-imdb

IMDb API clients for JavaScript/TypeScript, Python, Go, Ruby, Java and PHP: title and name search, charts, ratings, credits, awards, episodes, reviews, images and title metadata. Official Crawlora SDKs for its hosted IMDb data API.

crawlora-amazon

Amazon API clients for JavaScript/TypeScript, Python, Go, Ruby, Java and PHP: product search, suggestions, product details and chart/category discovery. Official Crawlora SDKs for its hosted Amazon data API.

minigun

Web scraping API to outsource tons of GET & xpath to cloud computing

crawlora-reddit

Reddit API clients for JavaScript/TypeScript, Python, Go, Ruby, Java and PHP: search, post and comment details, subreddit feeds, user history, domain listings, trends and leads. Official Crawlora SDKs for its hosted Reddit data API.

context-dev-haystack

Haystack components for Context.dev: live web search, scraping and crawling for RAG pipelines.

emailsanta

Python library to "send a letter to Santa" using emailsanta.com and receive a properly-formatted plaintext reply

web-scraping-api-sdk

Web scraping API examples in Python, Node, Go, Java, PHP, Ruby, cURL and CLI. Proxies, JS rendering, AI extraction, 9 scrapers.