PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Crawl Python Packages

Python packages with the GitHub topic crawl. Sorted by relevance, with stars and monthly downloads.
tavily-ai
tavily-python

The Tavily Python SDK allows for easy interaction with the Tavily API, offering the full range of our search, extract, crawl, map, and research functionalities directly from your Python programs. Easily integrate smart search, content extraction, and research capabilities into your applications, harnessing Tavily's powerful features.

5.6M 1K 155
ReaJason
xhs

基于小红书 Web 端进行的请求封装。https://reajason.github.io/xhs/

11K 2K 444
AWeirdDev
air-web

A lightweight package for crawling the web with the minimalist of code.

4K 0 0
0xMassi
webclaw

Official Python SDK for the Webclaw web extraction API

1K 1 1
yaroslaff
nudecrawler

Crawl telegra.ph searching for nudes!

923 362 27
WwwwwyDev
crawlist

A universal solution for web crawling lists

504 107 1
gabfl
sitecrawl

Simple Python module to crawl a website and extract URLs

398 4 0
GeoRouv
crawldiff

git log for any website. Track what changed on any site with AI-powered summaries.

362 6 0
tekofx
renfepy

Python library for crawl trains from renfe

225 1 0
truethari
fcrawler

Python application that can be used to copy files of a given file type from a folder directory.

211 2 0
BertramYe
preparser

a slight preparser to help parse webpage content or get request from urls,which supports win, mac and unix.

170 1 0
ma-pony
font-obfuscator

字体反爬、字体混淆工具是一个用于混淆字体文件的工具,可以将字体文件中的字形进行混淆,从而防止字体文件被直接提取出来。Font Obfuscator is an open-source Python library designed to prevent web scraping by obfuscating the character-to-glyph mapping in font files.

165 14 4
ReaJason
xhs-fork

基于小红书 Web 端进行的请求封装。https://reajason.github.io/xhs/

61 2K 444
Tsotsi
universal-utils

python utils

52 1 0
RevoltSecurities
spideyx

SpideyX - A Web Reconnaissance Penetration Testing tool for Penetration Testers and Ethical Hackers

48 192 31
    • Data from PyPI, GitHub, ClickHouse, and BigQuery