Web Scrapping Python Packages

pyscrappy

Adaptive Python web scraping toolkit + MCP server for AI agents. Self-healing selectors that survive site changes, TLS-fingerprint stealth to bypass anti-bot filters, CSS/XPath parsing, and 24 built-in scrapers, clean, structured, LLM-ready data from any URL.

rotten-tomatoes-scraper

How to scrape the Rotten Tomatoes website and extract metadata from actor and movie pages.

langchain-agentql

AgentQL's integrations with workflow automation tools and AI agent frameworks let you extract structured data from web pages using queries or natural language and interact with the web with Playwright. Resilient, fast, and AI-ready.

pysychonaut

Unofficial python api for Erowid, PsychonautWiki and AskTheCaterpillar

sololearnlib

Library that retrieves public data from sololearn.com

facebook-posts-details

Scrape public Facebook posts, reels, videos, photos and profiles. Python library + CLI returning likes, comments, shares and author details. No API key.

bnmp-scraper

Navega pela API do Portal BNMP coletando dados

pywuzzuf

An unofficial, async-first Python client for the Wuzzuf Jobs API

vidfetch

An open-source dataset download tool to obtain copyright-free videos from various free video websites.

silica-x

Silinosic-X is an extensible OSINT and digital footprint intelligence framework built in Python. It enables cross-platform identity discovery, domain and infrastructure reconnaissance, signal fusion, entity correlation, and exposure risk analysis across 70+ online platforms.