✳flâneur — a map of the web's best reading

Simplifying S4 · Hazy Research

hazyresearch.stanford.edu · 9,551 words · saved by 1 readers

Explaining S4 from the first principles of signal processing.

Simplifying S4 · Hazy Research Jun 21, 2022 · 42 min read Simplifying S4 Chris Ré , Dan Fu , Karan Goel , Khaled Saab . One goal of deep learning research is to find the simplest architectures that lead to the amazing results that we've seen for the last few years. In that spirit, we discuss the recent S4 architecture, which we think is simple—the structured state space model at its heart has been the most basic building block for generations of electrical engineers. However, S4 has seemed mysterious—and there are some subtleties to getting it to work in deep learning settings efficiently. We

Explore this link on the map →

related reading