An Alien Mind: Jakub Pachocki Warns Us - by Zvi Mowshowitz

OpenAI Chief Scientist Jakub Pachocki is dropping truth bombs.

OpenAI Chief Scientist Jakub Pachocki is dropping truth bombs. Tomorrow I will discuss Astra’s lack of monitorability, and the potential contributing factors to that. The situation is alarming and should freak you out, and briefly it looked, in the wake of leaked architectural changes, like the situation might be even more alarming than it is. Jakub rushed to try and head off misunderstandings that might lead to a race to the bottom on monitorability. An Excellent Warning. Branches of the Tech Tree. Universally Better Is Not Required. Alignment To What and To Whom. Monitorability. The…

saved by

• mateus de sousa
• Alex Yun

related reading

• AI 2027ai-2027.com
• Alignment remains a hard, unsolved problem — LessWronglesswrong.com
• Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
• Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
• The Artificiality of Alignmentjoinreboot.org
• AI 2027ai-2027.com
• Current AIs seem pretty misaligned to me — LessWronglesswrong.com
• AI #178: A Fire Alarm For General Intelligencethezvi.substack.com
• Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
• The state of AI safety in four fake graphs — LessWronglesswrong.com
• Are we existentially threatened by the type of AI misalignment seen in the OpenAI Hugging Face attack? — LessWronglesswrong.com
• A positive case for how we might succeed at prosaic AI alignment — AI Alignment Forumalignmentforum.org