url-extractor
Sitemap to URL crawler: turn any sitemap.xml into a clean, deduplicated URL list with lastmod/changefreq/priority. Perfect for RAG, SEO & AI agents. No API key.
nostrax is a fast, async web crawler and URL extraction toolkit for mapping, analyzing, and auditing websites.
