Short Timelines don't Devalue Long Horizon Research — LessWrong
Short AI takeoff timelines seem to leave no time for some lines of alignment research to become impactful. But any research rebalances the mix of currently legible research directions that could be handed off to AI-assisted alignment researchers or early autonomous AI researchers whenever they show up. So even hopelessly incomplete research agendas could still be used to prompt future capable AI to focus on them, while in the absence of such incomplete research agendas we'd need to rely on AI's judgment more completely. This doesn't crucially depend on giving significant probability to long AI takeoff timelines, or on expected value in such scenarios driving the priorities. Potential for AI to take up the torch makes it reasonable to still prioritize things that have no hope at all of becoming practical for decades (with human effort). How well AIs can be directed to advance a line of research further (and the quality of choices about where they should be directed) depends on how well
x Short Timelines Don't Devalue Long Horizon Research — LessWrong Agent Foundations AI Takeoff Cause Prioritization AI Frontpage 2025 Top Fifty: 15 % 179 Short Timelines Don't Devalue Long Horizon Research by Vladimir_Nesov 9th Apr 2025 AI Alignment Forum 1 min read 24 179 Ω 72 Short AI takeoff timelines seem to leave no time for some lines of alignment research to become impactful. But any research rebalances the mix of currently legible research directions that could be handed off to AI-assisted alignment researchers or early autonomous AI researchers whenever they show up . So even hopeless
Explore this link on the map →saved by
related reading
- AI 2027ai-2027.com
- A note about differential technological development — LessWronglesswrong.com
- I Would Have Solved Alignment, But I Was Worried That Would Advance Timelines — LessWronglesswrong.com
- Tips for Empirical Alignment Research — AI Alignment Forumalignmentforum.org
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- Can we safely automate alignment research? - Joe Carlsmithjoecarlsmith.com
- Sequent: Scale and Automation for Higher Confidence in Alignment — Sequentsequent.org
- Short AI Timelines Aren’t Always Higher-Leverageforethought.org
- The Case Against AI Control Research — LessWronglesswrong.com
- Sequent: scale and automation for higher confidence in alignment — AI Alignment Forumalignmentforum.org
- My picture of the present in AI — LessWronglesswrong.com
- Preparing for the Intelligence Explosionforethought.org