bachlechner21a.pdf

N/A

ReZero is All You Need: Fast Convergence at Large Depth Thomas Bachlechner1 Bodhisattwa Prasad Majumder2 Henry Mao3 Gary Cottrell2 Julian McAuley2 1 MeetElise, USA, 2 Computer Science and Engineering, UC San Diego, USA, 3 Altum…

saved by

• DonutLord

related reading

• transformer_attention.pdfarxiv.org
• Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
• The Annotated Transformernlp.seas.harvard.edu
• NL.pdfabehrouz.github.io
• The Little Book of Deep Learningfleuret.org
• Understanding deep learning requires rethinking generalizationarxiv.org
• [2605.01172] A Theory of Generalization in Deep Learningarxiv.org
• The Decade of Deep Learning | Leo Gaobmk.sh
• learning theorypeople.eecs.berkeley.edu
• [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
• 1706.03762arxiv.org
• https://aclanthology.org/P19-1285.pdfaclanthology.org