Crawling Python Python Packages

scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

wrapper-tls-requests

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

tibia-py

API to parse tibia.com content into python objects.

crawlipt

The script for selenium in python

facebook-page-info-scraper

Free Facebook pages MetaData Scraping Library - Unlimited Calls

crawlist

A universal solution for web crawling lists

filecrawler

File Crawler index files and search hard-coded credentials.

scrapy-proxy-headers

Add custom proxy headers to HTTPS requests in Scrapy

proxy-randomizer

This library helps you sfetly crawle apis and web pages

endabyss

Recon Crawling Endpoint and Parameter Scan Tool

kafka-scrapy-connect

A custom library that integrates Scrapy with Kafka.

mcqueen

A Collection Of Information-Gathering Tools 🌐

webtranspose

Web scraping API for building AI applications.

pw-simple-scraper

A simple and light Playwright-based scraper

solidscraper

This package lets your script scrape web sites. JQuery-Like API.

musubi-scrape

A convenient crawling package for collecting web data.

iflow-mcp-d4vinci-scrapling

Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web Scraping easy and effortless as it should be!

newscrap

Google News Scraper CLI for OSINT and research

scrapling-zhng

Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web Scraping easy again! In an internet filled with complications,