✳flâneur — a map of the web's best reading

How Big a Deal are MatMul-Free Transformers? — LessWrong

lesswrong.com · 2,518 words · saved by 1 readers

If you’re already familiar with the technical side of LLMs, you can skip the first section. …

x How Big a Deal are MatMul-Free Transformers? — LessWrong Academic Papers Transformers AI Frontpage 19 How Big a Deal are MatMul-Free Transformers? by JustisMills 27th Jun 2024 Linkpost for justismills.substack.com 6 min read 6 19 If you’re already familiar with the technical side of LLMs, you can skip the first section. The story so far Modern Large Language Models - your ChatGPTs, your Geminis - are a particular kind of transformer , a deep learning architecture invented about seven years ago . Without getting into the weeds , transformers basically work by turning an input into numbers, an

Explore this link on the map →

related reading