利用语音和生物反馈预测产品反馈访谈中的用户参与度
Using Voice and Biofeedback to Predict User Engagement during Product Feedback Interviews
AI总结:
本文提出利用生理和语音等生物特征数据预测产品反馈访谈中的用户参与度,实验表明基于生物特征和仅语音特征的监督学习分别达到F1=0.72和0.71,是需求工程和软件工程中较早引入生物特征与语音分析的研究。
摘要:
捕捉用户的参与度对于收集软件产品功能的反馈至关重要。在市场驱动的背景下,当前收集和分析用户反馈的方法基于从产品评论和社交媒体中提取信息的技术。这些方法在定制软件开发中,或在需要从特定用户处收集信息的情境下,几乎不适用。在这种情况下,公司需要借助面对面访谈来获取关于其产品的反馈。在本文中,我们提出利用生物特征数据,即生理和语音特征,来补充访谈信息,以了解用户在所讨论的产品相关主题上的参与度。我们通过访谈用户来评估我们的方法,同时使用Empatica E4腕带收集他们的生理数据(即生物反馈),并通过普通笔记本电脑的默认录音机捕捉他们的语音。我们的结果表明,我们可以通过在生物特征数据上训练监督机器学习算法来预测用户的参与度(F1=0.72),并且仅使用语音特征就足够有效(F1=0.71)。我们的工作贡献了需求工程中最早使用生物特征识别情绪的研究之一。这也是软件工程中首个考虑语音分析的研究。语音特征的使用对于远程通信中情绪感知的需求获取可能特别有帮助,无论是由人类分析师还是基于语音的聊天机器人执行,并且还可以用于支持软件工程研究中的会议分析。
英文摘要:
Capturing users' engagement is crucial for gathering feedback about the features of a software product. In a market-driven context, current approaches to collect and analyze users' feedback are based on techniques leveraging information extracted from product reviews and social media. These approaches are hardly applicable in bespoke software development, or in contexts in which one needs to gather information from specific users. In such cases, companies need to resort to face-to-face interviews to get feedback on their products. In this paper, we propose to utilize biometric data, in terms of physiological and voice features, to complement interviews with information about the engagement of the user on the discussed product-relevant topics. We evaluate our approach by interviewing users while gathering their physiological data (i.e., biofeedback) using an Empatica E4 wristband, and capturing their voice through the default audio-recorder of a common laptop. Our results show that we can predict users' engagement by training supervised machine learning algorithms on biometric data (F1=0.72), and that voice features alone are sufficiently effective (F1=0.71). Our work contributes with one the first studies in requirements engineering in which biometrics are used to identify emotions. This is also the first study in software engineering that considers voice analysis. The usage of voice features could be particularly helpful for emotion-aware requirements elicitation in remote communication, either performed by human analysts or voice-based chatbots, and can also be exploited to support the analysis of meetings in software engineering research.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。