✳flâneur — a map of the web's best reading

GPUs Go Brrr · Hazy Research

hazyresearch.stanford.edu · 4,846 words · saved by 1 readers

how make gpu fast?

GPUs Go Brrr · Hazy Research May 12, 2024 · 26 min read GPUs Go Brrr Benjamin Spector , Aaryan Singhal , Simran Arora , Chris Re AI uses an awful lot of compute . In the last few years we’ve focused a great deal of our work on making AI use less compute (e.g. Based , Monarch Mixer , H3 , Hyena , S4 , among others) and run more efficiently on the compute that we have (e.g. FlashAttention , FlashAttention-2 , FlashFFTConv ). Lately, reflecting on these questions has prompted us to take a step back, and ask two questions: What does the hardware actually want? And how can we give that to it? This

Explore this link on the map →

related reading