Nov. 16 2021

[dovahcrow]

What's worked on last week

ConnectorX:

• Continue work on big query @Yizhou150
• Fix CTE support issue @wangxiaoying
• Check ssh tunnel issue @wangxiaoying

EDA:

• Optimize the code of create_diff_report @devinllu
• Read metadata from db @sahmad11
• Fix type issue [DataPrep.EDA] create_report cannot interpret 'Int64Dtype()' as a data type [DataPrep.EDA] create_report cannot interpret 'Int64Dtype()' as a data type #733 @jinglinpeng

Clean:

• Implement the frontend @AndyWangSFU
• Add commonly-used clean functions @qidanrui
• Add README.md for clean GUI frontend @qidanrui

Integrate:

• Search how user use hot libraries and consider how to design my project @chency87
• Investigate and realize the limitations of sql_metadata library @zshandy

The followings are discussed during the meeting

What's going on this week

ConnectorX:

• Add big query @Yizhou150 @Wukkkinz-0725
• Finish todos for next milestone @wangxiaoying

EDA:

• Add docs and tests for create_diff_report @devinllu
• Continue working on plot_db @sahmad11
• Enrich interaction on create_report @jinglinpeng

Clean:

• Get the CI ready @qidanrui
• Change the website @qidanrui
• Implement frontend @AndyWangSFU

Integrate:

• Investigate how to parse the dependence in ETL pipeline @chency87
• Research on either generalize SQL query or consider it as a NLP problem @zshandy