PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Scraping Websites Python Packages

Python packages with the GitHub topic scraping-websites. Sorted by relevance, with stars and monthly downloads.
kennethreitz
requests-html

Pythonic HTML Parsing for Humans™

565K 327 42
Anorov
cfscrape

A Python module to bypass Cloudflare's anti-bot page.

48K 4K 450
outscraper
outscraper

The library provides convenient access to the Outscraper API from applications written in the Python language. Allows using Outscraper's services from your code.

44K 93 21
proxycrawl
proxycrawl

ProxyCrawl Python library for scraping and crawling

4K 58 19
TeamKillerX
tgcore

TgCore • Designed for complex systems. Made simple. A fluent DSL for building Telegram bots, APIs, and AI workflows.

4K 3 0
crawlbase-source
crawlbase

Fast python library for the Crawlbase API

2K 25 2
sujitmandal
scrape-search-engine

Search anything on the different Search Engine's it will collect all the links.

1K 14 5
multimodal-ai-lab
scrapemm

LLM-friendly scraper for media and text from social media and the open web.

978 6 0
fedecalendino
nintendeals

Library with a set of tools for scraping information about Nintendo games and its prices across all regions (NA, EU and JP).

780 129 18
outscraper
google-maps-reviews

Python SDK that allows fetching Google Maps Reviews from any place. Fetch reviews from any business on Google Maps without limitations.

681 14 5
outscraper
google-services-api

The library provides convenient access to the Outscraper API from applications written in the Python language. Allows using Outscraper's services from your code.

652 93 21
okaits
nicovideo-py

ニコニコ動画に投稿された動画の情報を取得するライブラリです。(動画をダウンロードすることはできません。)

651 0 0
JordanAllen101
aioprox

Async Python proxy manager with latency testing

588 1 0
pyporn-san
multporn

A python library used to scrape and download from Multporn.net

552 28 1
Javinator9889
g-pygle

A tool for searching the entire web with the Google technology

535 5 1
andriystr
lst

Declarative Scraping Library

477 0 0
edwardseley
lyricscorpora

An unofficial Python API that allows users to create a corpus of lyrical text from their favorite artists and billboard charts

423 18 1
sarartur
liquidcss

Alters css selector names across css files and html templates.

373 3 0
proxymesh
scrapy-proxy-headers

Handle custom proxy headers when making HTTPS requests through proxies in scrapy

357 4 0
erikqu
newsdatascraper

Python package that helps you easily retrieve complete web articles, new and old

319 5 0
Indigo-Coder-github
korean-news-crawler

Python Library for Crawling News Artircles in Korean Top 10 News Websites with Utilities

235 1 0
danangfir
indoquake

A Latest Earthquake Detection Package Taken Based on BMKG | Meteorological, Climatological, and Geophysical Agency

224 0 0
HubTou
pnu-libgh

GitHub scraping tool and library

212 1 1
Musubi-ai
musubi-scrape

Musubi: A convenient crawling tool for collecting web text data in Python.

195 1 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery