arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.10946cs.HCcs.AI
收藏

人机交互中的自我情境感知情绪感知

Self context-aware emotion perception on human-robot interaction

Universidad Central de Chile(智利中央大学);University of New South Wales(新南威尔士大学)

Zihan Lin, Francisco Cruz, Eduardo Benitez Sandoval

AI总结:

针对长期人机交互中主流情绪识别忽视情境的问题,提出SCAM模型,利用二维情绪坐标系、信息保留结构和情境损失提升音频、视觉及多模态识别准确率。

摘要:

情绪识别在人机交互的各个领域中发挥着关键作用。在与人类的长期交互中,机器人需要持续且准确地作出响应;然而,主流情绪识别方法大多聚焦于短期情绪识别,忽视了情绪被感知时所处的情境。人类会考虑情境信息,而不同情境可能导致完全不同的情绪表达。本文提出自我情境感知模型(SCAM),该模型采用二维情绪坐标系来锚定并重新标注不同情绪。同时,它融合了其独特的信息保留结构和情境损失。该方法在音频、视频和多模态方面均取得显著改进。在听觉模态中,准确率显著提升,由63.10%升至72.46%。同样,视觉模态的准确率也有所提高,由77.03%升至80.82%。在多模态方面,准确率由77.48%提升至78.93%。未来,我们将通过心理学实验验证SCAM在机器人上的可靠性和可用性。

英文摘要:

Emotion recognition plays a crucial role in various domains of human-robot interaction. In long-term interactions with humans, robots need to respond continuously and accurately, however, the mainstream emotion recognition methods mostly focus on short-term emotion recognition, disregarding the context in which emotions are perceived. Humans consider that contextual information and different contexts can lead to completely different emotional expressions. In this paper, we introduce self context-aware model (SCAM) that employs a two-dimensional emotion coordinate system for anchoring and re-labeling distinct emotions. Simultaneously, it incorporates its distinctive information retention structure and contextual loss. This approach has yielded significant improvements across audio, video, and multimodal. In the auditory modality, there has been a notable enhancement in accuracy, rising from 63.10% to 72.46%. Similarly, the visual modality has demonstrated improved accuracy, increasing from 77.03% to 80.82%. In the multimodal, accuracy has experienced an elevation from 77.48% to 78.93%. In the future, we will validate the reliability and usability of SCAM on robots through psychology experiments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑