✳flâneur — a map of the web's best reading
[2207.09238] Formal Algorithms for Transformers
arxiv.org · 535 words · saved by 2 readers
This document aims to be a self-contained, mathematically precise overview of transformer architectures and algorithms (*not* results). It covers what transformers are, how they are trained, what they are used for, their key architectural components, and a preview of the most prominent models. The reader is assumed to be familiar with basic ML terminology and simpler neural network architectures such as MLPs.
Explore this link on the map →