This project aims to create an interactive dashboard which displays Sentiment Analysis scores of Companies using the most recent news. This repository contains the steps to obtain data and sentiment scores, the web application codes can be accessed on the DevOps_Fintech_Website and DevOps_Fintech_Website_Backend repository.
├── data
│ ├── initialise_news XXXX-XX-XX
├── initialise_news.py
├── predict.py
. .
. .
Currently, data is populated for Top 30 companies on NASDAQ Index (as of 2020) for the time period 2020 Jan to 2021 Feb. The companies are saved in companies.txt and are used for news querying on Google News API on RapidAPI.
As the Google News API has a query limit of 3 requests per hour, code has been adjusted to work around that limitation and loop around multiple API keys to fetch news in a more efficient manner. Data shall be fetched and stored into csv, then subsequently processed for prediction score and populated into the SQLite3 database used for the Fintech Society website.
To add in new companies, run python initialise_news.py. Data obtained will be stored in a csv file.
To add in news for new time period, run python update_news.py.
Note: run predict and updating to database to be updated
Given a .csv file, predict.py produces a .csv file including the sentences in the text.