Attention-Residuals/Attention_Residuals.pdf at master · MoonshotAI/Attention-Residuals

N/A

saved by

• Neel Redkar
• Lydia Nottingham
• Eric Huang

related reading

• Attention Residualsk-a.in
• A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
• Chapter 1: Transformer Interpretability - ARENAlearn.arena.education
• Transformer (deep learning) - Wikipediaen.wikipedia.org
• Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
• Residual neural network - Wikipediaen.wikipedia.org
• The Annotated Transformernlp.seas.harvard.edu
• pytorch-image-models/timm/models/vision_transformer.py at main · huggingface/pytorch-image-models · GitHubgithub.com
• arxiv.org/pdf/2512.24880#page=3.56arxiv.org
• flash-attention/csrc/flash_attn/src/flash_fwd_kernel.h at main · Dao-AILab/flash-attention · GitHubgithub.com
• Overleaf Examplearxiv.org
• What is an attention mechanism? | IBMibm.com