Product Alignment is not Superintelligence Alignment (and we need the latter to survive) — LessWrong
lesswrong.com · 3,209 words · saved by 1 readers
tl;dr: progress on making Claude friendly[1] is not the same as progress on making it safe to build godlike superintelligence. solving the former doe…
x Product Alignment is not Superintelligence Alignment (and we need the latter to survive) — LessWrong AI-Assisted Alignment Superintelligence Terminology / Jargon (meta) AI Frontpage 2026 Top Fifty: 14 % 168 Product Alignment is not Superintelligence Alignment (and we need the latter to survive) by plex 31st Mar 2026 3 min read 20 168 tl;dr: progress on making Claude friendly [1] is not the same as progress on making it safe to build godlike superintelligence. solving the former does not imply we get a good future. [2] please track the difference. [edit: terminology note: Local vs Asymptotic
related reading
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- Alignment is not solved but it increasingly looks solvablealigned.substack.com
- “Alignment Engineering” vs. “Misalignment Science”lesswrong.com
- The Artificiality of Alignmentjoinreboot.org
- PSA: Almost nobody is directly working on superintelligent alignment — LessWronglesswrong.com
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- Defining alignment research — LessWronglesswrong.com
- Alignment & Succession: The Two Bars of Alignmentnosetgauge.com
- What is AI alignment? - by Adam Jones - BlueDot Impactblog.bluedot.org
- Neurotechnology is Critical for AI Alignmentmilan.cvitkovic.net
- The Case Against AI Control Research — LessWronglesswrong.com
- I Would Have Solved Alignment, But I Was Worried That Would Advance Timelines — LessWronglesswrong.com