Unsupervised Feature Learning and Deep Learning Tutorial
As a refresher, we will start by learning how to implement linear regression. The main idea is to get familiar with objective functions, computing their gradients and optimizing the objectives over a set of parameters. These basic tools will form the basis for more sophisticated algorithms later. Readers that want additional details may refer to the Lecture Note on Supervised Learning for more. Our goal in linear regression is to predict a target value y 𝑦 starting from a vector of input values x∈ R n 𝑥 ∈ ℜ 𝑛 . For example, we might want to make predictions about the price of a house so that y 𝑦 represents the price of the house in dollars and the elements x j 𝑥 𝑗 of x 𝑥 represent “features” that describe the house (such as its size and the number of bedrooms). Suppose that we are given many examples of houses where the features for the i’th house are denoted x (i) 𝑥 ( 𝑖 ) and the price is y (i) 𝑦 ( 𝑖 ) . For short, we will denote the Our goal is to find a functi
Unsupervised Feature Learning and Deep Learning Tutorial UFLDL Tutorial Home !--> Linear Regression 28 Aug 2013 ---> Problem Formulation As a refresher, we will start by learning how to implement linear regression. The main idea is to get familiar with objective functions, computing their gradients and optimizing the objectives over a set of parameters. These basic tools will form the basis for more sophisticated algorithms later. Readers that want additional details may refer to the Lecture Note on Supervised Learning for more. Our goal in linear regression is to predict a target value y star
related reading
- Linear Regressionmlu-explain.github.io
- deeplearningbook.org/contents/ml.htmldeeplearningbook.org
- Neural networks and deep learningneuralnetworksanddeeplearning.com
- Practical Deep Learning for Coders - Practical Deep Learningcourse.fast.ai
- Lecture 7 - Deep Learning Foundations: Neural Tangent Kernelsyoutube.com
- The Little Book of Deep Learningfleuret.org
- 6.036_notes.pdfphillipi.github.io
- https://www.deeplearningbook.org/contents/linear_algebra.htmldeeplearningbook.org
- 3.2. Object-Oriented Design for Implementation — Dive into Deep Learning 1.0.3 documentationd2l.ai
- Functions are Vectorsthenumb.at
- CS231n Deep Learning for Computer Visioncs231n.github.io
- sparseAutoencoder.pdfweb.stanford.edu