Dimensanality reduction
Performed a dimensanality reduction using PCA and t-SNE
Dimensionality reduction, or dimension reduction, is the transformation of data from a high-dimensional space into a low-dimensional space so that the low-dimensional representation retains some meaningful properties of the original data.
- First we want Standardize the given Data.
- Calculate the covariance matrix X of data points.
- Calculate eigen vectors and corresponding eigen values.
- Sort the eigen vectors according to their eigen values in decreasing order.
- Choose first k eigen vectors and that will be the new k dimensions.
- Transform the original n dimensional data points into k dimensions. Eigen Vectors: These vectors gives the in which direction the maximal spread occurs in the data.
https://medium.com/analytics-vidhya/dimensionality-reduction-in-machine-learning-179ba0c83066
Linear regression is perhaps one of the most well known and well-understood algorithms in statistics and machine learning. Linear regression was developed in the field of statistics and is studied as a model for understanding the relationship between input and output numerical variables, but with the course of time, it has become an integral part of the modern machine learning toolbox.
Linear Regression is all about finding a line (or) plane that fits the given data as well as possible.
y=mx+b, Here m is the slope of the line and b is the y-intercept. it is the equation similar to algebra. But in statistics, the points do not lie perfectly on a line. it models around which the data lie if a strong line pattern exists.
'https://medium.com/analytics-vidhya/intuition-and-implementation-of-linear-regression-b1d2509d458e'