prothomalo-scrubber.py

a newspaper scrubber for http://prothom-alo.com to collect the images and their corresponding caption.

dailystar-scrubber.py

a newspaper scrubber for http://www.thedailystar.net to collect news info.

installing dependencies

just use pip install -r requirements.txt

parameters - for prothom-alo

set start_date and end_date

parameters - for dailystar

set category and page range

using script

after installing dependencies and setting the parameters just run with python dailystar-scrubber.py or python prothomalo-scrubber.py