A scrapy-based crawler for crawling Exploit Database
This is a web crawler based on Scrapy for crawling EXP information on the Exploit Database(a CVE compliant archive of public exploits and corresponding vulnerable software).
What can you do with this web crawler?
- Crawling all the exploit information on Exploit Database to the local area;
- Do some data analysis on the exploit information that has been crawled;
- Download all the exploit scripts on Exploit Database.
$ git clone https://github.com/Dy1aNT/Exploit-DB-Spider.git
$ cd Exploit-DB-Spider
Install dependencies
$ pip install -r requirements.txt
$ python main.py
