The Plan — LessWrong
lesswrong.com · 9,845 words · saved by 1 readers
Step 1: sort out our fundamental confusions about agency …
17 min read • • • • • • • • • • • • • • • • This is a high-level overview of the reasoning behind my research priorities, written as a Q&A. What’s your plan for AI alignment? Step 1: sort out our fundamental confusions about agency Step 2: ambitious value learning (i.e. build an AI which correctly learns human values and optimizes for them) Step 3: … Step 4: profit! … and do all that before AGI kills us all. That sounds… awfully optimistic. Do you actually think that’s viable? Better than a 50/50 chance of working in time. Do you just have really long timelines?…
saved by
related reading
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- The Plan - 2023 Version — LessWronglesswrong.com
- Study Guide — LessWronglesswrong.com
- AI 2040: Plan Aai-2040.com
- The Case Against AI Control Research — LessWronglesswrong.com
- The Plan - 2025 Update — LessWronglesswrong.com
- What’s the short timeline plan? — LessWronglesswrong.com
- Plans A, B, C, and D for misalignment risk — LessWronglesswrong.com
- Towards a scale-free theory of intelligent agency — AI Alignment Forumalignmentforum.org
- Research Agenda: Synthesizing Standalone World-Models — AI Alignment Forumalignmentforum.org
- A Pragmatic Vision for Interpretability — AI Alignment Forumalignmentforum.org
- Why Agent Foundations? An Overly Abstract Explanation — LessWronglesswrong.com