Review of Statistical Learning Theory (CS 281A) at Berkeley
Now that I’ve finished my first semester at Berkeley, I think it’s time for me to review how I felt about the two classes I took: Statistical Learning Theory (CS 281A) and Natural Language Processing (CS 288). In this post, I’ll discuss CS 281a, a class that I’m extremely happy I took even if it was a bit stressful to be in lecture (more on that later). First of all, what is statistical learning theory? I view the subject as one that principally deals with the problem of finding a predictive function of data that minimizes a loss function (e.g., squared loss) on training data, and analyzes this problem in a framework that conflates machine learning and probability methods. Whereas a standard machine learning course might primarily describe various learning algorithms, statistical learning theory focuses on the subset of these that are most well-suited to statistical analysis. For instance, regression is a common learning algorithm, and regularization is a common (statistical?) techniqu
Now that I’ve finished my first semester at Berkeley, I think it’s time for me to review how I felt about the two classes I took: Statistical Learning Theory (CS 281A) and Natural Language Processing (CS 288). In this post, I’ll discuss CS 281a, a class that I’m extremely happy I took even if it was a bit stressful to be in lecture (more on that later). First of all, what is statistical learning theory? I view the subject as one that principally deals with the problem of finding a predictive function of data that minimizes a loss function (e.g., squared loss) on training data, and analyzes thi
saved by
related reading
- 6.036_notes.pdfphillipi.github.io
- Yes you should understand backprop | by Andrej Karpathy | Mediumkarpathy.medium.com
- Maybe I was too harsh on deep learning theory (three days ago) — LessWronglesswrong.com
- CS231n Deep Learning for Computer Visioncs231n.github.io
- SFT, RL, and On-Policy Distillation Through a Distributional Lens | whnrehiew.github.io
- Contentsermongroup.github.io
- course_stat_rl.pdfmit.edu
- CSC 151 - A computer scientist's perspective on data scienceeikmeier.sites.grinnell.edu
- Statistical learning theory - Wikipediaen.wikipedia.org
- CS231n Deep Learning for Computer Visioncs231n.github.io
- Prompts for Open Problemsargmin.net
- A Course in Machine Learningciml.info