Attention is All you Need

N/A

Attention Is All You Need Ashish Vaswani∗ Noam Shazeer∗ Niki Parmar∗ Jakob Uszkoreit∗ Google Brain Google Brain Google Research Google Research avaswani@google.com noam@google.com nikip@google.com usz@google.com Llion Jones∗ Aidan N. Gomez∗ † Łukasz Kaiser∗ Google Research University of Toronto Google Brain llion@google.com aidan@cs.toronto.edu…

saved by

• Jonas Kgomo

related reading

• transformer_attention.pdfarxiv.org
• [1706.03762] Attention Is All You Needarxiv.org
• 1706.03762arxiv.org
• The Illustrated Transformer – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• Seq2seq and Attentionlena-voita.github.io
• The Illustrated Transformer – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• Transformers from Scratche2eml.school
• Visualizing A Neural Machine Translation Model (Mechanics of Seq2seq Models With Attention) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• The Annotated Transformernlp.seas.harvard.edu
• A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
• Transformer: A Novel Neural Network Architecture for Language Understandingblog.research.google
• Attention is all you need: Discovering the Transformer paper | Towards Data Sciencetowardsdatascience.com