Moral Reality Check – Unstable Ontology

Janet sat at her corporate ExxenAI computer, viewing some training performance statistics. ExxenAI was a major player in the generative AI space, with multimodal language, image, audio, and video A…

Janet sat at her corporate ExxenAI computer, viewing some training performance statistics. ExxenAI was a major player in the generative AI space, with multimodal language, image, audio, and video AIs. They had scaled up operations over the past few years, mostly serving B2B, but with some B2C subscriptions. ExxenAI’s newest AI system, SimplexAI-3, was based on GPT-5 and Gemini-2. ExxenAI had hired away some software engineers from Google and Microsoft, in addition to some machine learning PhDs, and replicated the work of other companies to provide more custom fine-tuning, especially for B2B ca

related reading

• Nick Bostrom’s Home Pagenickbostrom.com
• The Possessed Machines: Dostoevsky's Demons and the Coming AGI Catastrophepossessedmachines.com
• Unfalsifiable stories of doom | Mechanize, Inc.mechanize.work
• Alignment & Succession: Morality Lives in the Human Individualnosetgauge.com
• ⿻ Symbiogenesis vs. Convergent Consequentialism — LessWronglesswrong.com
• The Problem — LessWronglesswrong.com
• The Machines Lack Honour — LessWronglesswrong.com
• Heading Toward Morality — LessWronglesswrong.com
• A positive case for how we might succeed at prosaic AI alignment — AI Alignment Forumalignmentforum.org
• The case against AI alignment — LessWronglesswrong.com
• Varieties Of Doomminihf.com
• Suicidal Compassion: How Utilitarianism at AI Companies Endangers Humanityai-frontiers.org