Making deals with early schemers — LessWrong
lesswrong.com · 11,634 words · saved by 2 readers
...could help us to prevent takeover attempts from more dangerous misaligned AIs created later.
x Making deals with early schemers — LessWrong Dealmaking (AI) AI Frontpage 2025 Top Fifty: 23 % 129 Making deals with early schemers by Julian Stastny , Olli Järviniemi , Buck 20th Jun 2025 AI Alignment Forum 18 min read 41 129 Ω 57 Consider the following vignette: It is March 2028. With their new CoCo-Q neuralese reasoning model , a frontier AI lab has managed to fully automate the process of software engineering. In AI R&D, most human engineers have lost their old jobs, and only a small number of researchers now coordinate large fleets of AI agents, each AI about 10x more productive than th
saved by
related reading
- The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
- The Case Against AI Control Research — LessWronglesswrong.com
- How do we (more) safely defer to AIs? — LessWronglesswrong.com
- Deep Deceptiveness — LessWronglesswrong.com
- AI Control: Improving Safety Despite Intentional Subversion — AI Alignment Forumalignmentforum.org
- I think alignment work is more promising than control work — LessWronglesswrong.com
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com
- Current AIs seem pretty misaligned to meblog.redwoodresearch.org
- Model Organisms of Misalignment: The Case for a New Pillar of Alignment Research — AI Alignment Forumalignmentforum.org
- New report: “Scheming AIs: Will AIs fake alignment during training in order to get power?”joecarlsmith.com
- Why are AI agents lying, cheating and coordinating?yoshuabengio.org