Optimal play in human-judged Debate usually won't answer your question - AI Alignment Forum
Note: I fully expect some readers to find the core of this post almost trivially obvious. If you’re such a reader, please read as “I think [obvious thing] is important”, rather than “I’ve discovered…
x Optimal play in human-judged Debate usually won't answer your question — AI Alignment Forum Debate (AI safety technique) AI Rationality Frontpage 20 Optimal play in human-judged Debate usually won't answer your question by Joe Collman 27th Jan 2021 15 min read 12 20 Epistemic status: highly confident (99%+) this is an issue for optimal play with human consequentialist judges. Thoughts on practical implications are more speculative, and involve much hand-waving (70% sure I’m not overlooking a trivial fix, and that this can’t be safely ignored). Note: I fully expect some readers to find the co
related reading
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- The limits of AI safety via debate — LessWronglesswrong.com
- [1805.00899] AI safety via debatear5iv.labs.arxiv.org
- Deep Deceptiveness — LessWronglesswrong.com
- [1805.00899] AI safety via debatearxiv.org
- Where I agree and disagree with Eliezer — LessWronglesswrong.com
- Without specific countermeasures, the easiest path to transformative AI likely leads to AI takeover — LessWronglesswrong.com
- How do we (more) safely defer to AIs? — LessWronglesswrong.com
- Anthropic Fall 2023 Debate Progress Update — AI Alignment Forumalignmentforum.org
- A positive case for how we might succeed at prosaic AI alignment — AI Alignment Forumalignmentforum.org
- Can we safely automate alignment research? - Joe Carlsmithjoecarlsmith.com
- Many arguments for AI x-risk are wrong — AI Alignment Forumalignmentforum.org