多模态对话系统中评估用户体验的参与度和融洽度量表开发与验证
Development and Validation of Engagement and Rapport Scales for Evaluating User Experience in Multimodal Dialogue Systems
AI总结：
本研究开发并验证了参与度和融洽度量表，用于评估外语学习场景下多模态对话系统的用户体验，实验表明量表能有效区分人机对话体验差异。
摘要：
本研究旨在开发和验证两个量表，分别测量参与度和融洽度，以评估在外语学习背景下多模态对话系统的用户体验质量。这些量表基于教育心理学、社会心理学和第二语言习得中的参与度理论设计。七十四名日语英语学习者与受过训练的人类导师和一个对话代理完成了角色扮演和讨论任务。每项对话任务完成后，他们填写了参与度和融洽度量表。通过两项分析研究了量表的效度和信度。我们首先进行了Cronbach's alpha系数分析和一系列验证性因子分析，以检验量表的结构效度和所设计项目的信度。然后，我们比较了与人类导师对话和与对话代理对话之间的参与度和融洽度得分。结果显示，我们的量表成功地从多个角度捕捉到了人类对话者和对话代理之间对话体验质量的差异。
英文摘要：
This study aimed to develop and validate two scales of engagement and rapport to evaluate the user experience quality with multimodal dialogue systems in the context of foreign language learning. The scales were designed based on theories of engagement in educational psychology, social psychology, and second language acquisition.Seventy-four Japanese learners of English completed roleplay and discussion tasks with trained human tutors and a dialog agent. After each dialogic task was completed, they responded to the scales of engagement and rapport. The validity and reliability of the scales were investigated through two analyses. We first conducted analysis of Cronbach's alpha coefficient and a series of confirmatory factor analyses to test the structural validity of the scales and the reliability of our designed items. We then compared the scores of engagement and rapport between the dialogue with human tutors and the one with a dialogue agent. The results revealed that our scales succeeded in capturing the difference in the dialogue experience quality between the human interlocutors and the dialogue agent from multiple perspectives.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
