✳flâneur — a map of the web's best reading
Double descent in human learning · Chris Said
chris-said.io · 1,392 words · saved by 1 readers
The uncanny resemblance between double descent and a 50 year old theory from psychology
Double descent in human learning · Chris Said --> Chris Said I am a data scientist at Propel. This blog is mostly about statistics, technology, and science. Double descent in human learning 21 Apr 2023 In machine learning, double descent is a surprising phenomenon where increasing the number of model parameters causes test performance to get better, then worse, and then better again. It refutes the classical overfitting finding that if you have too many parameters in your model, your test error will always keep getting worse with more parameters. For a surprisingly wide range of models
Explore this link on the map →related reading
- Deep Double Descent (cross-posted on OpenAI blog) – Windows On Theorywindowsontheory.org
- Understanding “Deep Double Descent” — LessWronglesswrong.com
- The Scaling Hypothesis · Gwern.netgwern.net
- Clare Lyle | What's grokking good for?clarelyle.com
- Human-like Neural Nets by Catapulting · Gwern.netgwern.net
- 4 – The Overfitting Iceberg – Machine Learning Blog | ML@CMU | Carnegie Mellon Universityblog.ml.cmu.edu
- A Theory of Deep Learning | Elements of a Vector Spaceelonlit.com
- [2503.02113] Deep Learning is Not So Mysterious or Differentarxiv.org
- [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
- The Little Book of Deep Learningfleuret.org
- On neural scaling and the quanta hypothesisericjmichaud.com
- Superposition, Memorization, and Double Descenttransformer-circuits.pub