PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Crawling Python Python Packages

Python packages with the GitHub topic crawling-python. Sorted by relevance, with stars and monthly downloads.
D4Vinci
scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

797K 68K 7K
thewebscraping
wrapper-tls-requests

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

112K 159 13
Galarzaa90
tibia-py

API to parse tibia.com content into python objects.

12K 40 15
wael-sudo2
facebook-page-info-scraper

Free Facebook pages MetaData Scraping Library - Unlimited Calls

784 61 8
esequiel378
proxy-randomizer

This library helps you sfetly crawle apis and web pages

485 8 1
WwwwwyDev
crawlipt

The script for selenium in python

449 139 2
WwwwwyDev
crawlist

A universal solution for web crawling lists

367 106 1
proxymesh
scrapy-proxy-headers

Add custom proxy headers to HTTPS requests in Scrapy

357 4 0
helviojunior
filecrawler

File Crawler index files and search hard-coded credentials

357 36 10
arrester
endabyss

Recon Crawling Endpoint and Parameter Scan Tool

335 2 0
spicyparrot
kafka-scrapy-connect

A custom library that integrates Scrapy with Kafka.

310 12 1
mike-gee
webtranspose

Web scraping API for building AI applications.

247 40 2
elecbrandy
pw-simple-scraper

simple web scraper using by playwright

247 0 0
Musubi-ai
musubi-scrape

A convenient crawling package for collecting web data.

195 1 0
hpcao299
mcqueen

A collection of information-gathering tools

193 2 0
sergioburdisso
solidscraper

This package lets your script scrape web sites. JQuery-Like API.

152 3 0
D4Vinci
iflow-mcp-d4vinci-scrapling

Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web Scraping easy and effortless as it should be!

145 68K 7K
opsysdebug
newscrap

Google News Scraper CLI for OSINT and research

123 55 13
D4Vinci
scrapling-zhng

Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web Scraping easy again! In an internet filled with complications,

107 68K 7K
    • Data from PyPI, GitHub, ClickHouse, and BigQuery