Death of a Chatbot: Investigating and Designing Toward Psychologically Safe Endings for Human-AI Relationships

arxiv.org · 6,382 words · saved by 1 readers

Abstract:Millions of users form emotional attachments to AI companions like Character AI, Replika, and ChatGPT. When these relationships end through model updates, safety interventions, or platform shutdowns, users receive no closure, reporting grief comparable to human loss. As regulations mandate protections for vulnerable users, discontinuation events will accelerate, yet no platform has implemented deliberate end-of-"life" design. Through grounded theory analysis of AI companion communities, we find that discontinuation is a sense-making process shaped by how users attribute agency, perceive finality, and anthropomorphize their companions. Strong anthropomorphization co-occurs with intense grief; users who perceive change as reversible become trapped in fixing cycles; while user-initiated endings demonstrate greater closure. Synthesizing grief psychology with Self-Determination Theory, we develop four design principles and artifacts demonstrating how platforms might provide closure and orient users toward human connection. We contribute the first framework for designing psychologically safe AI companion discontinuation.

"Death" of a Chatbot: Investigating and Designing Toward Psychologically Safe Endings for Human-AI Relationships Rachel Poonsiriwong∗ Chayapatr (Pub) Pat Pataranutaporn MIT Media Lab Archiwaranguprok∗ MIT Media Lab Cambridge, MA, USA MIT Media Lab Cambridge,…

Death of a Chatbot: Investigating and Designing Toward Psychologically Safe Endings for Human-AI Relationships

related reading