[2608.19549] Generating Diverse Personas for User Simulators to Test Interview Dialogue Systems
Abstract:This paper addresses the issue of the significant labor required to test interview dialogue systems. While interview dialogue systems are expected to be useful in various scenarios, like other dialogue systems, testing them with human users requires significant effort and cost. Therefore, testing with user simulators can be beneficial. Since most conventional user simulators have been primarily designed for training task-oriented dialogue systems, little attention has been paid to the personas of the simulated users. During development, testing interview dialogue systems requires simulating a wide range of user behaviors, but manually creating a large number of personas is labor-intensive. We propose a method that automatically generates personas for user simulators using a large language model. Furthermore, by assigning personality traits related to communication styles when generating personas, we aim to increase the diversity of communication styles in the user simulator. Experimental results show that the proposed method enables the user simulator to generate utterances with greater variation.
Generating Diverse Personas for User Simulators to Test Interview Dialogue Systems Mikio Nakano1,2 , Kazunori Komatani2 , Hironori Takeuchi3 1 C4A Research Institute, Inc., Setagaya, Tokyo, Japan 2 SANKEN,…
saved by
related reading
- [2606.06614] Re-Centering Humans in LLM Personalizationarxiv.org
- [2608.00478] Ekova: A Personality-Support Agent for Self-Discovery Dialoguearxiv.org
- [2605.21739] AttuneBench: A Conversation-Based Benchmark for LLM Emotional Intelligencearxiv.org
- Today, we are releasing a research preview of our user model, along with a set of evaluations designed to measure how faithfully user models capture human behavior.persimmon.humansand.ai
- [2304.03442] Generative Agents: Interactive Simulacra of Human Behaviorarxiv.org
- The Persona Selection Model: Why AI Assistants might Behave like Humansalignment.anthropic.com
- [2304.03442] Generative Agents: Interactive Simulacra of Human Behaviorarxiv.org
- Simulating the World with 8.3 Billion Persona Agentsarxiv.org
- Training and Evaluating User Language Modelsarxiv.org
- Generative Agent Simulations of 1,000 Peopleantephase.com
- Simulating Users with State Alignment Beats Response Imitationhumanlm.stanford.edu
- Quantifying the Utility of User Simulators for Building Collaborative LLM Assistantsarxiv.org