milestones-EPC.txt

CS302 Final Project
Eli Carter
GitHub: https://github.com/elivolunteer/cs302_final

Challenge07 Rubric:

10pts - Watch intro videos for Google NPL API
5pts - Watch intro videos for Tweepy API
10pts - Set up and start twitter developer account 
15pts - Writing script to connect to twitter and scrape tweets from trending tags

Hour Log:


Report:
1.5 hrs Planning project with group
1.0 hrs Watching Sentdex Google API intro videos
1.0 hrs Researched and installed twitter apis
3.0 hrs Wrote python connection to twitter, learned how the data returned way srtuctures, parsed, and saved said data

Total: 6.5 hrs

The challenge went well, it was interesting learning how to connect to different APIs. Figuring out how to setup our structure and 
python enviornment was also interested.

Individual Demo and Update 9/11/21:
Hours Log: 
   Researching NPL Strats: 2.5 hrs
      Start with regressors (Linear, SVM, XGBoost) - 2.5 hrs
   Reading papers on NLP standard practices: 1 hr
      https://aclanthology.org/S17-2089.pdf - 0.75 hrs
      https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9142175&tag=1 - 0.25 hrs
   Creating a baseline of "random guessing" to compare models to: 0.25 hrs
   Extending twitter pull: 2 hrs
      Loop through the last year with python datetime objects and append to files - 1 hr
      Pulling full data set and hunting down errors with apis - 1 hr
   Random Forest: 3.5 hrs
      Research and reading of random trees, forests, and bagging/boosting - 0.5 hrs
      Creating simple grid search of random forest - 0.5 hrs
      Focused on num estimators parameter and added plotting functions from grid search - 1.5 hrs
      Narrowed down max depth range - 0.5 hrs
      Narrowed down forest size range - 0.5 hrs
   Keras Neural Network: 6 hrs
      Created simple neural network in keras in python notebook - 1 hr
      Tried different architectures and researched different encodings - 5 hrs
   Odds and ends: 4 hrs
      Created exportable versions of classifers - 1 hr
      Created BYODS presentation - 1.5 hrs
      Created demo day presentation - 0.5 hrs
      Created README / User Guide - 1 hr
   
   Total: 19.25 hours