Understanding the Covariance Matrix | DataScience+
This article is showing a geometric and intuitive explanation of the covariance matrix and the way it describes the shape of a data set. We will describe the geometric relationship of the covariance matrix with the use of linear transformations and eigendecomposition. Before we get started, we shall take a quick look at the difference between covariance and variance. Variance measures the variation of a single random variable (like the height of a person in a population), whereas covariance is a measure of how much two random variables vary together (like the height of a person and the weight of a person in a population). The formula for variance is given by σ 2 x = 1 n − 1 n ∑ i = 1 ( x i – ¯ x ) 2 σx2=1n−1∑i=1n(xi–x¯)2 where n n is the number of samples (e.g. the number of people) and ¯ x x¯ is the mean of the random variable x x (represented as a vector). The covariance σ ( x , y ) σ(x,y) of two random variables x x and y y is given by σ ( x , y ) = 1 n − 1 n ∑ i = 1
Understanding the Covariance Matrix August 3, 2018 · 9 min read · 482.5K views · 17 comments Share: This article is showing a geometric and intuitive explanation of the covariance matrix and the way it describes the shape of a data set. We will describe the geometric relationship of the covariance matrix with the use of linear transformations and eigendecomposition. Introduction Before we get started, we shall take a quick look at the difference between covariance and variance. Variance measures the variation of a single random variable (like the height of a person in a population), whereas co
Explore this link on the map →related reading
- matrixcookbook.pdfmath.uwaterloo.ca
- https://www.deeplearningbook.org/contents/linear_algebra.htmldeeplearningbook.org
- Singular Value Decomposition as Simply as Possiblegregorygundersen.com
- Singular value decomposition - Wikipediaen.wikipedia.org
- dimensionality reduction - Relationship between SVD and PCA. How to use SVD to perform PCA? - Cross Validatedstats.stackexchange.com
- An Intuitive Guide to Linear Algebra – BetterExplainedbetterexplained.com
- Principal component analysis - Wikipediaen.wikipedia.org
- pca - What is the intuition behind SVD? - Cross Validatedstats.stackexchange.com
- Principal Component Analysis (PCA): Explained Step-by-Step | Built Inbuiltin.com
- Pen and Paper Exercises in Machine Learningarxiv.org
- Aman's AI Journal • CS229 • Principal Component Analysisaman.ai
- Some ML-Related Math I Now Understand Better — LessWronglesswrong.com