Requirements Python 3.4+ Dependencies beautifulsoup4 lxml numpy pandas pyodbc requests SQLAlchemy fake-useragent Usage Create an environment $ conda create -n dev Activate the new environment # on windows $ activate dev # on Linux or macOS $ source activate dev Installation dependency $ pip install -r requirements.txt Run $ python main.py