Urllib Python Packages

robust-downloader

Minimal Python downloader with robustness in mind - resumable downloads, retries, and more

request-boost

A better requests and urllib. A simple package for hitting multiple URLs and performing GET/POST requests in parallel.

polite-http

A courteous, dependency-free HTTP client with rate limiting, retries, and backoff.

pyodide-http

Provides patches for widely used http libraries to make them work in Pyodide environments like JupyterLite

g-pygle

A tool for searching the entire web with the Google technology

extproxy

ExtProxy extend urllib2's ProxyHandler to support extra proxy types: HTTPS, SOCKS. It provides a consistent user experience like HTTP proxy for the users.

pathlibutil

python __class__ inherits from pathlib.Path with methods for hashing, copying, deleting and more

pymarketcap

Python3 API wrapper and web scraper for https://coinmarketcap.com

aiogeoip

Real asynchronous geolocation by IP address with asyncio support.

normalurl

Convenient utility to parse and normalize urls.

pantheon-ssrf-guard

Two-layer SSRF egress guard for Python's stdlib HTTP that survives DNS rebinding.

crawlerutils

Utils for programming web crawler

smd

Simple Manga Downloader, a tool to search and download manga

thttp

A lightweight wrapper around urllib

urllib-s3

S3 handler for urllib

larzhttp

An ergonomic HTTP client in pure Python — requests-style API over urllib, with sessions, JSON, retries, timeouts, gzip. Zero dependencies.

urlfix

Check and Fix Outdated URLs

unittest-sandbox

unittest-sandbox provides a sandbox decorator which ensures unit test methods do not make any web/socket requests during test execution.

extractlinks

extract and repair links from Requests objects, including redirects and final landing page