Thought Experiments Provide a Third Anchor
Previously, I argued [https://bounded-regret.ghost.io/future-ml-systems-will-be-qualitatively-different/] that we should expect future ML systems to often exhibit "emergent" behavior, where they acquire new capabilities that were not explicitly designed or intended, simply as a result of scaling. This was a special case of a general phenomenon in the physical
Previously, I argued that we should expect future ML systems to often exhibit "emergent" behavior, where they acquire new capabilities that were not explicitly designed or intended, simply as a result of scaling. This was a special case of a general phenomenon in the physical sciences called More Is Different. I care about this because I think AI will have a huge impact on society, and I want to forecast what future systems will be like so that I can steer things to be better. To that end, I find More Is Different to be troubling and disorienting. I’m inclined to forecast the future by looking
Explore this link on the map →related reading
- Future ML Systems Will Be Qualitatively Differentbounded-regret.ghost.io
- Future ML Systems Will Be Qualitatively Different — LessWronglesswrong.com
- ML Systems Will Have Weird Failure Modesbounded-regret.ghost.io
- More Is Different for AIbounded-regret.ghost.io
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
- My picture of the present in AI — LessWronglesswrong.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- What failure looks like — LessWronglesswrong.com
- Forecasting transformative AI: the "biological anchors" method in a nutshellcold-takes.com