The philosophic turn for AI agents: replacing centralized digital rhetoric with decentralized truth-seeking | Mind & Society
In the face of rapidly advancing AI technology, individuals will increasingly rely on AI agents to navigate life’s growing complexities, raising critical concerns about maintaining both human agency and autonomy. This paper addresses a fundamental dilemma posed by AI decision-support systems: the risk of either becoming overwhelmed by complex decisions, thus losing agency, or having autonomy compromised by externally controlled choice architectures reminiscent of “nudging” practices. While the “nudge” framework, based on the use of choice-framing to guide individuals toward presumed beneficial outcomes, initially appeared to preserve liberty, at AI-driven scale, it threatens to erode autonomy. To counteract this risk, the paper proposes a philosophic turn in AI design. AI should be constructed to facilitate decentralized truth-seeking and open-ended inquiry, mirroring the Socratic method of philosophical dialogue. By promoting individual and collective adaptive learning, such AI system
1 Introduction Modernity has greatly expanded opportunities for individuals. It has also vastly increased the burden of questions that individuals need to take on board for opportunities to be realized. With increasing capabilities of AI and their impact on how we live and work, this trend stands to dramatically accelerate. It will increasingly be the case that effectively operating in the modern world will require the assistance of AI agents that help us make choices and help us identify what choices and questions we should consider. Against this background, we face an apparent dilemma…
saved by
related reading
- Coasean Bargaining at Scaleblog.cosmos-institute.org
- AI Safety for Fleshy Humans: a whirlwind touraisafety.dance
- The Artificial Selftheartificialself.ai
- Deep Deceptiveness — LessWronglesswrong.com
- Radical Optionality — Governing Transformative AI Under Uncertaintyradical-optionality.ai
- [2502.15657] Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path?arxiv.org
- Critique of Agent Modelarxiv.org
- After Orthogonality: Virtue-Ethical Agency and AI Alignmentthegradient.pub
- [2206.13353] Is Power-Seeking AI an Existential Risk?arxiv.org
- [2605.10310] Positive Alignment: Artificial Intelligence for Human Flourishingarxiv.org
- Intrinsic Power-Seeking: AI Might Seek Power for Power’s Saketurntrout.com
- Gradual Disempowerment: Systemic Existential Risks from Incremental AI Developmentarxiv.org