2103.15949.pdf

N/A

Transformer visualization via dictionary learning: contextualized embedding as a linear superposition of transformer factors Zeyu Yun∗ 2 Yubei Chen∗ 1,2 Bruno A Olshausen2,4 Yann LeCun1,3 1 Facebook AI Research 2…

related reading

• [2103.15949] Transformer visualization via dictionary learning: contextualized embedding as a linear superposition of transformer factorsarxiv.org
• Towards Monosemanticity: Decomposing Language Models With Dictionary Learningtransformer-circuits.pub
• A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
• Transformer Circuits Threadtransformer-circuits.pub
• Towards Monosemanticity: Decomposing Language Models With Dictionary Learningtransformer-circuits.pub
• Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
• The Illustrated Transformer – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• Transformers from Scratche2eml.school
• Interfaces for Explaining Transformer Language Models – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• Softmax Linear Unitstransformer-circuits.pub
• The Annotated Transformernlp.seas.harvard.edu
• Circuits Updates - January 2024transformer-circuits.pub