Scrapper Python Packages

architect-net

Low-level network engine for browser fingerprint emulation. Bypasses WAFs via uTLS, ECH, and HTTP/2 frame manipulation.

quoras

A Python package collect data from Quora.

moddb

A Python scrapper to access ModDB mods, games and more as objects

elicznik

Tauron eLicznik Python module

mitreattackscrapper

A package for conveniently retrieving MITRE ATT&CK data

crawlerfriend

A light weight crawler which gives search results in HTML form or in Dictionary form, given URLs and keywords.

fiction-dl

A content downloader, capable of retrieving works of (fan)fiction from the web and saving them in a few common file formats.

tweetscrape

Scrape the Twitter frontend API without any authentication and restriction.

proxyz

scrape proxies from more than 5 different sources and check which ones are still alive

zillow-scraper

This library scrapes zillow property website

ctft

CLI tool to get and view stylised CTFTime.org writeups in your terminal.

proxy-master

Python module to scrap FREE proxies from websites

comic-dl

Comic-dl is a command line tool to download manga and comics from various comic and manga sites. Supported sites : readcomiconline.to, mangafox.me, comic naver and many more.

pexel-downloader

Download images and videos from Pexels.

lyricscorpora

An unofficial Python API that allows users to create a corpus of lyrical text from their favorite artists and billboard charts

finavis

another unofficial api for some financial visualization website

scrapper-helpers

Scrapper helpers

aytch

AYTCH - Async YouTube Channel Scrapper without API keys and limits.

wclone

Basic website cloner written in Python

pyolxbrazil

Scrapper for OLX Brazil

imgscrapy

A simple and fast CLI for multithreaded image scraping with support for headless scraping of dynamic websites.

pyolx

Python scrapper for olx

snagit

🔎 Yet another scrapping tool

instagscrape

A Python library to access Instagram's private API.