arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.11522cs.CL
收藏

揭示引人入胜对话的秘密:让用户沉迷于角色扮演对话代理的因素

Unveiling the Secrets of Engaging Conversations: Factors that Keep Users Hooked on Role-Playing Dialog Agents

Zhejiang University(浙江大学);School of Engineering, Westlake University(西湖大学工程学院);Scietrain(赛创科技)

Shuai Zhang, Yu Lu, Junwen Liu, Jia Yu, Huachuan Qiu, Yuming Yan, Zhenzhong Lan

AI总结:

本文通过分析真实用户与数千个角色的互动数据,发现角色扮演对话代理的留存率主要受每轮发言长度影响,而非角色体现程度,为改进大型语言模型提供见解。

摘要:

随着对话代理越来越像人类,人们现在能够进行从短暂时刻到相当长一段时间的持续对话。理解维持这些互动的因素至关重要,然而现有研究主要聚焦于短期模拟,很少探索如此长时间的真实对话。在本文中,我们研究了影响与角色扮演模型真实互动中留存率的因素。通过分析真实用户与数千个角色之间互动的大型数据集,我们系统地考察了多个因素,并评估了它们对用户留存率的影响。令人惊讶的是,我们发现机器人对其扮演角色的体现程度对留存率影响有限,而它每轮发言的长度却显著影响留存率。这项研究揭示了用户与角色扮演模型互动中的关键方面,并为未来改进用于角色扮演目的的大型语言模型提供了宝贵的见解。

英文摘要:

With the growing humanlike nature of dialog agents, people are now engaging in extended conversations that can stretch from brief moments to substantial periods of time. Understanding the factors that contribute to sustaining these interactions is crucial, yet existing studies primarily focusing on short-term simulations that rarely explore such prolonged and real conversations. In this paper, we investigate the factors influencing retention rates in real interactions with roleplaying models. By analyzing a large dataset of interactions between real users and thousands of characters, we systematically examine multiple factors and assess their impact on user retention rate. Surprisingly, we find that the degree to which the bot embodies the roles it plays has limited influence on retention rates, while the length of each turn it speaks significantly affects retention rates. This study sheds light on the critical aspects of user engagement with role-playing models and provides valuable insights for future improvements in the development of large language models for role-playing purposes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑