Sitemap Python Packages

ultimate-sitemap-parser

Ultimate Website Sitemap Parser

sitemap-python

A Python utility for building sitemaps.

indexgap

Quality control for programmatic-SEO pipelines: catches invented numbers, template-wide breakage, near-duplicates and broken hreflang before you publish. Zero dependencies, Python 3.9+, English and Russian output.

sluicer

Turn any web page, or a whole site, into structured data, with no model in the loop: every record a page declares with where each value came from, fields learnt from one example and checked on every page, crawls, feeds and archives.

django-icv-sitemaps

Scalable sitemap generation for Django: background XML sitemaps, robots.txt, llms.txt, security.txt, redirects, and 404 logging

flask-sitemapper

Flask extension for generating XML sitemaps

crawlableseo

Make a client-rendered SPA crawlable from its own HTML shell: per-URL meta tags, JSON-LD, robots.txt, sitemap.xml, llms.txt and IndexNow from one declaration. No headless browser, no SSR.

djangocms-page-sitemap

django CMS page extension to handle sitemap customization

fundus

A very simple news crawler with a funny name

c2pa-scanner

Scan website sitemaps for AI-generated images via C2PA and EXIF/XMP provenance - an EU AI Act Art. 50 labeling helper (Python/Textual TUI).

sitemap-tracker

Crawls websites and generates standards-compliant sitemap.xml files. Supports Playwright for JS rendering and httpx for fast HTTP crawling

atomno-mcp-seo-audit

MCP server for technical SEO audits powered by the detail.web engine: health score, 78 checks across 8 categories, robots/sitemap/JSON-LD/meta tools, GEO sub-score.

wayback-machine-archiver

A Python script to submit web pages to the Wayback Machine for archiving.

image-sitemap

Image Sitemap Generator SEO tool

trollhunter

Twitter Troll & Fake News Hunter - Crawls news websites and twitter to identify fake news

gsc-indexer-mcp

MCP server for Google Search Console - index status, URL inspection, request indexing, sitemap submission and search analytics for Claude and other AI agents.

astrocrawl

Async web crawler powered by Playwright headless Chromium — JavaScript rendering, AI-powered extraction (OpenAI / Anthropic / Google), CSS rule engine with visual preview, and a full PySide6 desktop GUI. SQLite WAL crash recovery, proxy circuit breaker, RFC 9309 robots.txt, ReDoS-immune regex, 3,822 tests. pip install astrocrawl[full,gui,fast].

getsitemap

A Python library that retrieves all URLs in the sitemaps on a website.

localsitemap

LocalSiteMap is an open-source Python package designed for generating sitemaps and sitemap indexes from local files. It crawls your root website directory and automatically builds standard-compliant sitemaps.

sitemap-harvester

Crawl sitemap of a given website and export metadata of its pages recursively into CSV format.

checksitemap

A tool to validate your sitemaps

django-seo-suite

Lightweight, extensible SEO metadata layer for Django: titles, meta tags, canonical URLs, hreflang, JSON-LD and Open Graph for models and views — plus a versioned robots.txt.

indexnow-ping

Submit sitemap URLs through IndexNow and optionally Google Search Console, with a robots.txt guard for pre-launch sites.

paka-sitemaps

Library that helps generate XML files according to sitemaps.org protocol.