arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2502.15367cs.HCcs.SDeess.AS
收藏

推进用户-语音交互:通过角色互换方法探索具备情感感知能力的语音助手

Advancing User-Voice Interaction: Exploring Emotion-Aware Voice Assistants Through a Role-Swapping Approach

University of Bergen(卑尔根大学);KTH Royal Institute of Technology(瑞典皇家理工学院);University of Surrey(萨里大学);Chalmers University of Technology(查尔姆斯理工大学);Norwegian University of Science and Technology(挪威科技大学)

Yong Ma, Yuchong Zhang, Di Fu, Stephanie Zubicueta Portales, Danica Kragic, Morten Fjeld

AI总结:

本研究采用角色互换方法探索语音助手交互中的人类情绪反应策略,通过分析多情绪场景的声学与语言模式,明确了情绪相关关键指标,为开发更具情感智能的自适应语音助手提供了依据。

摘要:

随着语音助手(VAs)日益融入日常生活,人们对能够识别用户情绪并做出恰当回应的情感感知系统的需求不断增长。尽管语音情感识别(SER)和情感分析已取得显著进展,但有效回应用户情绪——尤其是负面情绪——仍是一项挑战。本研究采用角色互换方法探索语音助手交互中的人类情绪反应策略,该方法中由参与者调节AI情绪,而非接收预编程的回应。通过语音特征分析和自然语言处理(NLP),我们研究了多种情绪场景下的声学和语言模式。结果显示,参与者在面对负面情绪线索时,更倾向于做出中性或积极的情绪回应,凸显出情绪调节和情绪降温的自然倾向。均方根(RMS)、过零率(ZCR)和抖动等关键声学指标被证实对情绪状态敏感,而情感极性和词汇多样性(TTR)可区分积极与消极回应。这些发现为开发能够提供共情、文化敏感且符合用户需求回应的自适应、情境感知语音助手提供了宝贵见解。通过了解人类在AI交互中如何自然调节情绪,本研究为设计更直观、更具情感智能的语音助手做出了贡献,可提升人机交互中的用户信任度与参与度。

英文摘要:

As voice assistants (VAs) become increasingly integrated into daily life, the need for emotion-aware systems that can recognize and respond appropriately to user emotions has grown. While significant progress has been made in speech emotion recognition (SER) and sentiment analysis, effectively addressing user emotions-particularly negative ones-remains a challenge. This study explores human emotional response strategies in VA interactions using a role-swapping approach, where participants regulate AI emotions rather than receiving pre-programmed responses. Through speech feature analysis and natural language processing (NLP), we examined acoustic and linguistic patterns across various emotional scenarios. Results show that participants favor neutral or positive emotional responses when engaging with negative emotional cues, highlighting a natural tendency toward emotional regulation and de-escalation. Key acoustic indicators such as root mean square (RMS), zero-crossing rate (ZCR), and jitter were identified as sensitive to emotional states, while sentiment polarity and lexical diversity (TTR) distinguished between positive and negative responses. These findings provide valuable insights for developing adaptive, context-aware VAs capable of delivering empathetic, culturally sensitive, and user-aligned responses. By understanding how humans naturally regulate emotions in AI interactions, this research contributes to the design of more intuitive and emotionally intelligent voice assistants, enhancing user trust and engagement in human-AI interactions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑