crawler-engine
A data gathering framework to search and get information from web sources
SpideyX - A Web Reconnaissance Penetration Testing tool for Penetration Testers and Ethical Hackers