Hot Chips 2026: Applying High Bandwidth Flash (HBF)
Machine learning workloads have an insatiable appetite for DRAM capacity. Flash memory is cheaper per gigabyte of capacity than DRAM. Could it offer a way out?
HBF, or High Bandwidth Flash, uses the same flash memory technology we see in SSDs today. Unlike SSDs, HBF is implemented much like HBM (High Bandwidth Memory). HBF cubes sit on the same package as a compute chip, perhaps even next to HBM. HBF’s idea is to offer much higher capacity than HBM, while still providing decent memory bandwidth. At Hot Chips 2026 tutorials day, Anurag Agarwal and Radhakrishna Giduthuri’s talk explores how HBF could apply to machine learning workloads. No HBF products exist yet, so the talk focuses on simulations, projections, and how software can adapt to take…
saved by
related reading
- Are you a memory_man, Part 2 - by Investing with Martinmartinbradstreet.substack.com
- An Interview with MatX CEO Reiner Pope About LLM Chipschipstrat.com
- 静水铭室 Silent Water and Curved Mountainliuliu.me
- The Inference Shift – Stratechery by Ben Thompsonstratechery.com
- A Close Look at SRAM for Inference in the Age of HBM Supremacyviksnewsletter.com
- How to Land a Frontier Lab Jobvladfeinberg.com
- A Close Look at SRAM for Inference in the Age of HBM Supremacyviksnewsletter.com
- Making Deep Learning go Brrrr From First Principleshorace.io
- Kepler — AI’s New Memorykeplercompute.com
- What Every Programmer Should Know About Memorypeople.freebsd.org
- Reiner Pope – The math behind how LLMs are trained and serveddwarkesh.com
- Hot Chipshotchips.org