✳flâneur — a map of the web's best reading

Fabian Fuchs

fabianfuchsml.github.io · 1,382 words · saved by 1 readers

# Gumbel Softmax This post introduces the Gumbel Softmax estimator for stochastic neural networks. It was simultaneously discovered by [Maddison et al.](https://arxiv.org/abs/1611.00712) and [Jang et al.](https://arxiv.org/abs/1611.01144), with both papers published at ICLR 2017. I took figures, equations and notation from the latter of the two. ## Vanilla Gumbel Softmax Estimator...

Fabian Fuchs Gumbel Softmax This post introduces the Gumbel Softmax estimator for stochastic neural networks. It was simultaneously discovered by Maddison et al. and Jang et al. , with both papers published at ICLR 2017. I took figures, equations and notation from the latter of the two. Vanilla Gumbel Softmax Estimator The Gumbel Softmax trick can be looked at from different angles. I will approach it from an attention angle, which has a broad range of applications in deep learning. For example, imagine a neural network that processes an image and decomposes it into multiple objects. Now we wa

Explore this link on the map →

saved by

related reading