The cosmopolitan-Leviathan enthymeme

Some argue that the natural way for a strong mind to form is by a group of smaller agents agreeing to ongoingly create new agents to trade w...

The cosmopolitan-Leviathan enthymeme September 21, 2023 Some argue that the natural way for a strong mind to form is by a group of smaller agents agreeing to ongoingly create new agents to trade with. Are there underlying premises about the nature of agents that would render valid some version of this argument? 1. Cosmopolitan Leviathan 2. Variations on the enthymeme If creative then anti-totalitarian Creativity comes with new values Subagents convergently trading away power to get strength Negotiating with summoned demons Trading with humans 3. Palinsynopsis 4. Presuming the ghost in the mach

related reading

• ⿻ Symbiogenesis vs. Convergent Consequentialism — LessWronglesswrong.com
• Does novel understanding imply novel agency / values?tsvibt.blogspot.com
• Beliefs are Chosen to Serve Goals — LessWronglesswrong.com
• Do not conquer what you cannot defend — LessWronglesswrong.com
• Towards a scale-free theory of intelligent agency — AI Alignment Forumalignmentforum.org
• Review: Planecrash — LessWronglesswrong.com
• [2411.00114] Project Sid: Many-agent simulations toward AI civilizationarxiv.org
• Optimality is the tiger, and agents are its teeth — LessWronglesswrong.com
• Dialogue: Is there a Natural Abstraction of Good? — LessWronglesswrong.com
• LLM Alignment, ethical and mathematical realism, and the most important actions in davidad's understanding — LessWronglesswrong.com
• Everett branches, inter-light cone trade and other alien matters: Appendix to “An ECL explainer” — EA Forumforum.effectivealtruism.org
• Forms of life, forms of mind | Dr. Michael Levin | Algorithms Redux: finding unexpected properties in truly minimal systemsthoughtforms.life