bachlechner21a.pdf

N/A

ReZero is All You Need: Fast Convergence at Large Depth Thomas Bachlechner1 Bodhisattwa Prasad Majumder2 Henry Mao3 Gary Cottrell2 Julian McAuley2 1 MeetElise, USA, 2 Computer Science and Engineering, UC San Diego, USA, 3 Altum…

saved by

• DonutLord

related reading

• The Decade of Deep Learning | Leo Gaobmk.sh
• Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
• The Little Book of Deep Learningfleuret.org
• arxiv.org/pdf/2512.24880#page=3.56arxiv.org
• learning theorypeople.eecs.berkeley.edu
• Statistical Mechanics of Deep Learningganguli-gang.stanford.edu
• A Theory of Deep Learning | Elements of a Vector Spaceelonlit.com
• Ilya 30u30arc.net
• [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
• 1512.03385arxiv.org
• What is Residual Connection? | Towards Data Sciencetowardsdatascience.com
• Residual neural network - Wikipediaen.wikipedia.org