Blog - Aleksa Gordić
aleksagordic.com · 281 words · saved by 3 readers
Long thinking.
Computers can be understood (< back to home) Get notified when I publish a new post. Inside TPU and GPU Clusters: The Anatomy of Collective Communication 2026-07-14 A deep dive into all-gather, reduce-scatter, all-reduce, and all-to-all communication on TPUs and GPUs. Inside the Transformer: The Life of a Token 2026-05-26 A deep dive into a modern dense transformer: YaRN, hybrid attention, soft capping, QK normalization, FLOPs/token, cluster sizing, and more. From Oura Ring to Dataset: Analyzing and Visualizing a Year of Biometric Data 2026-02-16 Visualizing and analyzing sleep,…
saved by
related reading
- blog | Henry Zhumaknee.github.io
- Inside the Transformer: The Life of a Token - Aleksa Gordićaleksagordic.com
- Home - colah's blogcolah.github.io
- Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
- The Illustrated Transformer – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
- Eric Jangevjang.com
- Ilya 30u30arc.net
- Inside NVIDIA GPUs: Anatomy of high performance matmul kernels - Aleksa Gordićaleksagordic.com
- Andrej Karpathy blogkarpathy.github.io
- Lil'Loglilianweng.github.io
- List of High-Signal Learning Materialsbrain.maxxyung.com
- Transformer Circuits Threadtransformer-circuits.pub