arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.03337cs.HCcs.AIcs.CYcs.LG

PsyDI:面向心理测量的个性化、逐步深入式聊天机器人

PsyDI: Towards a Personalized and Progressively In-depth Chatbot for Psychological Measurements

Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Shanghai JiaoTong University(上海交通大学);SenseTime Research(商汤科技研究院)

Xueyan Li, Xinyan Chen, Yazhe Niu, Shuai Hu, Yu Liu

AI总结:

针对传统心理测量方法的缺陷与大语言模型单轮交互的局限,研究提出个性化逐步深入式聊天机器人PsyDI,结合新型排序训练范式构建鲁棒评分模型,以MBTI测量为例验证了有效性,线上部署获超3000次访问,代码已开源。

摘要:

在心理学领域,标准化量表等传统评估方法常因静态性、缺乏个性化、参与者参与度低而饱受诟病,而全面的咨询评估往往难以获取。心理特质量化的复杂性进一步限制了这些方法的应用。尽管大语言模型(LLM)已取得进展,但许多仍依赖单轮问答交互。为填补这一空白,我们提出PsyDI——一款专为心理测量设计的个性化、逐步深入式聊天机器人,并以其在迈尔斯-布里格斯类型指标(MBTI)框架中的应用为例进行说明。PsyDI利用与用户相关的多模态信息,开展定制化多轮交互,在确保MBTI类型判定准确性的同时,提供个性化、易获取的测量服务。为应对心理特质难以量化的挑战,我们提出一种新型训练范式,该范式学习与这些特质相关的代理变量的排序,最终构建出用于MBTI测量的鲁棒评分模型。该评分模型使PsyDI能够在统一的评估语境下,通过多轮交互开展全面精准的测量。通过多项实验,我们验证了评分模型与PsyDI流程的有效性,证明其具备作为心理测量通用框架的潜力。此外,PsyDI的线上部署已获得大量用户参与,访问量超3000次,收集了大量标注有MBTI类型的多轮对话数据,为后续研究提供了支持。其训练与网页服务组件的源代码作为OpenDILab的一部分公开于:https://github.com/opendilab/PsyDI

英文摘要:

In the field of psychology, traditional assessment methods, such as standardized scales, are frequently critiqued for their static nature, lack of personalization, and reduced participant engagement, while comprehensive counseling evaluations are often inaccessible. The complexity of quantifying psychological traits further limits these methods. Despite advances with large language models (LLMs), many still depend on single-round Question-and-Answer interactions. To bridge this gap, we introduce PsyDI, a personalized and progressively in-depth chatbot designed for psychological measurements, exemplified by its application in the Myers-Briggs Type Indicator (MBTI) framework. PsyDI leverages user-related multi-modal information and engages in customized, multi-turn interactions to provide personalized, easily accessible measurements, while ensuring precise MBTI type determination. To address the challenge of unquantifiable psychological traits, we introduce a novel training paradigm that involves learning the ranking of proxy variables associated with these traits, culminating in a robust score model for MBTI measurements. The score model enables PsyDI to conduct comprehensive and precise measurements through multi-turn interactions within a unified estimation context. Through various experiments, we validate the efficacy of both the score model and the PsyDI pipeline, demonstrating its potential to serve as a general framework for psychological measurements. Furthermore, the online deployment of PsyDI has garnered substantial user engagement, with over 3,000 visits, resulting in the collection of numerous multi-turn dialogues annotated with MBTI types, which facilitates further research. The source code for the training and web service components is publicly available as a part of OpenDILab at: https://github.com/opendilab/PsyDI

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑