Skip to content

Latest commit

 

History

History

Analysis Workflow using Git, Python, and Jupyter

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 

Talk Recording

You can find the recording of the talk here or on YouTube.

Talk Prerequisites

  • Installing Git Bash (Windows only)
    • You can find the installation files for Git Bash at the official Git website
    • When installing make sure you select an editor other than the default Vim, notepad is okay, and make sure that the default branch name is main and not master. These are options that you can select in the prompts when installing Git Bash.
  • Installing Python via Anaconda
    • You can find the latest Ananconda distribution on the official Anaconda website
  • Installing VSCode Integrated Development Environment (IDE)
    • You can find the latest VSCode distribution on the official VSCode website
  • Installing VSCode extensions
    • In VSCode, within the left-hand sidebar click on the extensions tab and search for and install the following extensions:
      • Jupyter
      • Jupyter Keymap
      • Jupyter Notebook Renderers
      • Python
      • Pylance

Talk Contents

  • Setting up a project file structure
    • How to organize your workspace to set up a project
  • Setting up Git
    • Configuring Git settings
    • Initializing a local Git repository
    • Ignoring files locally (project specific)
    • Ignoring files globally (project non-specific)
    • Create a new Git Branch
  • Virtual environments
    • Create a Python virtual environment
    • Install required Python modules
    • Activating/deactivating the virtual environment
  • Data management
    • Applying CHMOD to raw data
    • Storing processed data
    • Ignoring data that contain sensitive information
  • Python Exploratory Data Analysis
    • Wrangling data with Pandas
    • Generating descriptive statistics
    • Creating interactive plots with Plotly
  • Git Workflow, Logs, and History
    • Staging & commiting
    • Thoughtful commits
    • Merging branches
    • Reading Git logs
    • Reverting to a previous project/file history