The Goodhart Singularity - by Tom Reed - Thomas’s Substack
substack.com · 4,195 words · saved by 2 readers
Automating R&D is not sufficient for superintelligence
Buyer beware: bombastic claims advanced, often flippantly. AI systems are starting to build themselves. Because each generation of model will be better at building its successor than the last, it seems plausible that the full automation of AI R&D could rapidly lead to an exponential growth in overall AI capabilities. A natural inference is that domain-general superintelligence arrives shortly after AI research is automated. This natural inference is, indeed, almost the default story of AI progress, as well as the strategy of those pursuing it. Where the AI industry once distinguished…
saved by
related reading
- Unresolved debates about the future of AIhelentoner.substack.com
- Why do people disagree about when powerful AI will arrive?blog.bluedot.org
- II. From AGI to Superintelligence: the Intelligence Explosion - SITUATIONAL AWARENESSsituational-awareness.ai
- AI 2027ai-2027.com
- The Gentle Singularity - Sam Altmanblog.samaltman.com
- What will be left for us to work on?normaltech.ai
- When AI builds itself \ Anthropicanthropic.com
- Why AGI Will Not Happen - Tim Dettmerstimdettmers.com
- AI 2027ai-2027.com
- Will AI R&D Automation Cause a Software Intelligence Explosion?forethought.org
- Why transformative artificial intelligence is really, really hard to achievethegradient.pub
- My Takeaways From AI 2027astralcodexten.com