Crawling Python Python Packages

scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

wrapper-tls-requests

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

tibia-py

API to parse tibia.com content into python objects.

facebook-page-info-scraper

Free Facebook pages MetaData Scraping Library - Unlimited Calls

proxy-randomizer

This library helps you sfetly crawle apis and web pages

crawlipt

The script for selenium in python

crawlist

A universal solution for web crawling lists

scrapy-proxy-headers

Handle custom proxy headers when making HTTPS requests through proxies in scrapy

filecrawler

File Crawler index files and search hard-coded credentials

endabyss

Recon Crawling Endpoint and Parameter Scan Tool

kafka-scrapy-connect

A custom library that integrates Scrapy with Kafka.

webtranspose

Web scraping API for building AI applications.

pw-simple-scraper

simple web scraper using by playwright

musubi-scrape

Musubi: A convenient crawling tool for collecting web text data in Python.

mcqueen

A collection of information-gathering tools

solidscraper

This package lets your script scrape web sites. JQuery-Like API.

iflow-mcp-d4vinci-scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

newscrap

Google News Scraper CLI for OSINT and research

scrapling-zhng

Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web Scraping easy again! In an internet filled with complications,