✳flâneur — a map of the web's best reading
Natural Latents: The Math — LessWrong
lesswrong.com · 2,222 words · saved by 1 readers
John Wentworth explains natural latents – a key mathematical concept in his approach to natural abstraction. Natural latents capture the "shared info…
x Natural Latents: The Math — LessWrong Best of LessWrong 2023 Natural Abstraction Abstraction AI Frontpage 131 Natural Latents: The Math by johnswentworth , David Lorell 27th Dec 2023 AI Alignment Forum 15 min read 41 131 Ω 49 Natural latents are a relatively elegant piece of math which we figured out over the past year, in our efforts to boil down and generalize various results and examples involving natural abstraction. In particular, this new framework handles approximation well, which was a major piece missing previously. This post will present the math of natural latents, with a handful
Explore this link on the map →related reading
- (Approximately) Deterministic Natural Latents — LessWronglesswrong.com
- The "Minimal Latents" Approach to Natural Abstractions — AI Alignment Forumalignmentforum.org
- Why Care About Natural Latents? — LessWronglesswrong.com
- Natural Abstractions: Key Claims, Theorems, and Critiques — LessWronglesswrong.com
- Visual Information Theory -- colah's blogcolah.github.io
- A Mathematical Theory of Communicationpeople.math.harvard.edu
- Kullback–Leibler divergence - Wikipediaen.wikipedia.org
- Natural Language Autoencoders Produce Unsupervised Explanations of LLM Activationstransformer-circuits.pub
- Gregory Gundersengregorygundersen.com
- Natural Language Autoencoders Produce Unsupervised Explanations of LLM Activations — LessWronglesswrong.com
- Latent and observable variables - Wikipediaen.wikipedia.org
- De Finetti's theorem - Wikipediaen.wikipedia.org