arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2210.14495cs.SDeess.AS
收藏

基于SVM融合声音和文本网络预测的两阶段维度情感识别

Two-stage dimensional emotion recognition by fusing predictions of acoustic and text networks using SVM

Japan Advanced Institute of Science and Technology(日本北陆先端科学技术大学院大学)

Bagus Tris Atmaja, Masato Akagi

摘要:

计算机自动语音情感识别是实现更自然的人机交互的关键。在人与人的互动中,正确感知情绪的能力对于在特定情况下采取进一步措施至关重要。SER中的一个问题是是否有必要将声学特征与其他数据(如面部表情、文本和运动捕捉)相结合。本研究提出结合声学和文本信息,采用后期融合方法,包括两个步骤。首先,在深度学习系统中分别训练声学和文本特征。其次,将来自深度学习系统的预测结果馈送到支持向量机(SVM)中以预测最终回归得分。此外,在本研究中的任务是维度情感建模,因为它可以使情感状态的更深入的分析。实验结果表明,这种两阶段,后期融合的方法,获得了更高的性能比任何一个一阶段的处理,从一个阶段到两个阶段的处理线性相关。这种后期融合方法改善了以前的早期融合结果,测量一致性相关系数得分。

英文摘要:

Automatic speech emotion recognition (SER) by a computer is a critical component for more natural human-machine interaction. As in human-human interaction, the capability to perceive emotion correctly is essential to take further steps in a particular situation. One issue in SER is whether it is necessary to combine acoustic features with other data such as facial expressions, text, and motion capture. This research proposes to combine acoustic and text information by applying a late-fusion approach consisting of two steps. First, acoustic and text features are trained separately in deep learning systems. Second, the prediction results from the deep learning systems are fed into a support vector machine (SVM) to predict the final regression score. Furthermore, the task in this research is dimensional emotion modeling because it can enable a deeper analysis of affective states. Experimental results show that this two-stage, late-fusion approach, obtains higher performance than that of any one-stage processing, with a linear correlation from one-stage to two-stage processing. This late-fusion approach improves previous early fusion results measured in concordance correlation coefficients score.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑