crawling-sites
Simple Python module to crawl a website and extract URLs
SpideyX a multipurpose Web Penetration Testing tool with asynchronous concurrent performance with multiple mode and configurations.