Neural-Networks-Machine-Learning

Notebooks in the area of Neural Networks and Machine learning. All the notebooks in this repo should have an open in colab button at the top of the notebook.

Note not all of these notebooks are finished!

Table of Contents

Gradient Descent

Linear Regression

Logistic Regression

PCA

XOR

Convolutional Neural Network

Long Short Term Memory Networks

Other Network Structures

Stats review

Control Systems

Gradient Descent

Gradient Descent 1

• Notebook discussing the basics of gradient descent

Gradient Descent 2

• Notebook discussing a more in depth example with gradient descent

Linear Regression

Linear Regression using Gradient Descent

• Notebook going over how to do linear regression using gradient descent by hand

Linear Regression LSM Normal

• Notebook going over how to do linear regression using Least Squares Method along with using matrix theory and the normal equation

Linear Regression using packages

• Notebook showing the different packages out there that can do linear regression. There are of course other packages that could do it, but this shows the 3 most popular

Linear Regression Logan's example

• Logan's notebook for linear regression

Logistic Regression

Logistic Regression using Gradient Descent

• Notebook going over how to do logistic regression using gradient descent by hand

Logistic Regression using PyTorch

• Notebook going over how to do logistic regression using PyTorch

Logistic Regression Logan's example

• Logan's notebook for logistic regression

PCA

PCA by hand

• A Notebook showing how PCA works using a handmade example

Why PCA is important

• Shows how to do PCA using packages and shows a use case to understand how PCA can be useful

XOR examples

XOR Example 1

XOR Example 2

XOR Example 3

XOR Example 4

Intro to PyTorch with XOR example

• Covers what the super position theory is and gives an example

Convolutional Neural Network

Intro to CNN

• An Introduction notebook to what a Convoluational Neural Network or CNN is

CNN PyTorch Example

• Example of how to code a CNN directly from PyTorch

CNN MNIST

• Another example of how to code a CNN

CNN with time series

• An Example of how to use a CNN on a time series

Long Short Term Memory Networks

Intro to LSTM

• Introduction to what an LSTM is

Advanced to LSTM

• Advanced example of how to use a LSTM network

Other Network Structures

Intro to variational autoencoder

• An introduction notebook over autoencoders

Variational Autoencoder example 1

• An example notebook over Variational Autoencoder

Variational Autoencoder example 2

• Another example notebook over Variational Autoencoder

Intro Recurrent networks

• An introduction notebook over Recurrent networks

RNN example

• An example of how to use a RRN network

GAN network example1

• An example how to make a gan network

GAN network example2

• An example how to make a gan network

Random Forest Trees

• Notebook over random forest trees

Stats review

Information and Entropy

• A notebook reviewing those two stats topics

KL Divergence and Cross Entropy

• A notebook reviewing those two stats topics

Covariance

• A notebook reviewing covariance

Maximum Likelihood Estimation

• A notebook reviewing maximum likelihood estimation (MLE)

Different distribution

• A notebook showing how to generate different distributions and small details about each distribution

Control systems

Super position

• Covers what the super position theory is and gives an example

Convolve

• Gives an example of summed impulse response vs np convolve function

Impulse Response

• An example notebook showing the different types of simulus to a system

first vs second order system

• Shows an example of different simulus to a first and second order system

discrete vs continuous

• shows the differences for the two types of inputs when modeling an input