crawling-sites
Simple Python module to crawl a website and extract URLs
SpideyX - A Web Reconnaissance Penetration Testing tool for Penetration Testers and Ethical Hackers