Understanding the Tucker decomposition, and compressing tensor-valued data (with R code) | 0-fold Cross-Validation
In many applications, data naturally form an n-way tensor with n > 2, rather than a “tidy” table. As mentioned in the beginning of my last blog post, a tensor is essentially a multi-dimensional array: a tensor of order one is a vector, which simply is a column of numbers, a tensor of order two is a matrix, which is basically numbers arranged in a rectangle, a tensor of order three looks like numbers arranged in rectangular box (or a cube, if all modes have the same dimension), an nth order (or n-way) tensor looks like numbers arranged in an n-hyperrectangle… you get the idea…
In many applications, data naturally form an n-way tensor with n > 2, rather than a “tidy” table. As mentioned in the beginning of my last blog post, a tensor is essentially a multi-dimensional array: a tensor of order one is a vector, which simply is a column of numbers, a tensor of order two is a matrix, which is basically numbers arranged in a rectangle, a tensor of order three looks like numbers arranged in rectangular box (or a cube, if all modes have the same dimension), an nth order (or n-way) tensor looks like numbers arranged in an n-hyperrectangle… you get the idea… In this…
saved by
related reading
- Singular value decomposition - Wikipediaen.wikipedia.org
- Singular Value Decomposition as Simply as Possiblegregorygundersen.com
- Tensor product - Wikipediaen.wikipedia.org
- Dimensionality reduction in neural data analysisxcorr.net
- How to Conquer Tensorphobia || Math ∩ Programmingjeremykun.com
- The Tensor: The fundamental data structure of ML - DEV Communitydev.to
- Tensor-Transformer Variants are Surprisingly Performant — LessWronglesswrong.com
- Tensor Considered Harmfulnlp.seas.harvard.edu
- https://www.deeplearningbook.org/contents/linear_algebra.htmldeeplearningbook.org
- Six (and a half) intuitions for SVD — LessWronglesswrong.com
- Auto-research with codex: How I achieved a 232x Faster Kernel over baseline with Codex in GPU Mode's qr_v2 problemsankalp.bearblog.dev
- dimensionality reduction - Relationship between SVD and PCA. How to use SVD to perform PCA? - Cross Validatedstats.stackexchange.com