Crawling webpages with selenium using Chrome driver/Firefox headless
Assuming that you have Selenium, Chrome driver and Firefox headless installed:
git clone https://github.com/sharad1126/WebScrapper
cd WebScrapper
pip install -r requirements.txt
python final_crawl_selenium.py
#and then wait for 30-35 seconds. In the meantime, driver will also open chrome browser to run the webpage.
python webpage_screenshot.py
#Will save the screenshot at a specified place as per the code
Sharad Agarwal [email protected]