1706.03762

N/A

# link_27rifwfi10l.pdf ## Metadata - PDFFormatVersion=1.5 - IsLinearized=false - IsAcroFormPresent=false - IsXFAPresent=false - IsCollectionPresent=false - IsSignaturesPresent=false - CreationDate=D:20240410211143Z - Creator=LaTeX with hyperref - ModDate=D:20240410211143Z - Custom.PTEX.Fullbanner=This is pdfTeX, Version 3.141592653-2.6-1.40.25 (TeX Live 2023) kpathsea version 6.3.5 - Producer=pdfTeX-1.40.25 - Trapped=False ## Contents ### Page 1 Provided proper attribution is provided, Google hereby grants permission to reproduce the tables and figures in this paper solely for use in journa

saved by

• Ratan Kaliani
• Hardeep Gambhir
• anka hu
• Saloni Shenoy

related reading

• transformer_attention.pdfarxiv.org
• [1706.03762] Attention Is All You Needarxiv.org
• Attention is All you Needproceedings.neurips.cc
• [1701.06538] Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layerarxiv.org
• The Illustrated Transformer – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• The Annotated Transformernlp.seas.harvard.edu
• A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
• The Annotated Transformernlp.seas.harvard.edu
• The Illustrated Transformer – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• Overleaf Examplearxiv.org
• [1807.03819] Universal Transformersarxiv.org
• 2502.11089arxiv.org