Genes did misalignment first: comparing gradient hacking and meiotic drive
My PhD is in evolutionary biology, and I spent much of my time learning and thinking about genetic governance mechanisms like meiosis. I find myself wanting a link to share on these concepts, so I'm publishing some old writing I did in 2022 that makes the comparison. Gradient descent can be compared to natural selection. Both are optimization algorithms. But while gradient descent is only decades old as part of the field of machine learning (ML), natural selection is the reason complex living beings like human readers exist. Are there any lessons we can learn about alignment by looking at the products of natural selection? Oly Sourbut has written up a set of conditions under which natural selection and gradient descent are equivalent, i.e., where the same inputs will lead to the same outputs under both algorithms, which is posted on lesswrong. At an intuitive level, the biggest difference between the two is that, whereas gradient descent involves estimating a local gradient and trying
Genes did misalignment first: comparing gradient hacking and meiotic drive Holly Elmore Apr 18, 2025 15 7 Share My PhD is in evolutionary biology, and I spent much of my time learning and thinking about genetic governance mechanisms like meiosis. I find myself wanting a link to share on these concepts, so I'm publishing some old writing I did in 2022 that makes the comparison. Gradient descent and natural selection are analogous Gradient descent can be compared to natural selection. Both are optimization algorithms. But while gradient descent is only decades old as part of the field of machine
Explore this link on the map →related reading
- Evolution as Backstop for Reinforcement Learning · Gwern.netgwern.net
- The Algernon Argument · Gwern.netgwern.net
- Mnemonic portraits for 19,023 human genes — LessWronglesswrong.com
- The Lower Bound to the Evolution of Mutation Rates - PMCncbi.nlm.nih.gov
- Muller's ratchet - Wikipediaen.wikipedia.org
- Deceptively Aligned Mesa-Optimizers: It's Not Funny If I Have To Explain Itastralcodexten.com
- Evolving to Extinction — LessWronglesswrong.com
- Inner Alignment: Explain like I'm 12 Edition — LessWronglesswrong.com
- Evolutionary Game Theory: Theoretical Concepts and Applications to Microbial Communitiesepub.ub.uni-muenchen.de
- Models Don't "Get Reward" — LessWronglesswrong.com
- Thou Art Godshatter — LessWronglesswrong.com
- Model Organisms of Misalignment: The Case for a New Pillar of Alignment Research — AI Alignment Forumalignmentforum.org