arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.01694cs.SDcs.CLeess.AS
收藏

动态窗口transFormer语音情感识别算法DWFormer

DWFormer: Dynamic Window transFormer for Speech Emotion Recognition

South China University of Technology(华南理工大学);VoiceAI Technologies(声智科技);Pazhou Laboratory(琶洲实验室)

Shuaiqi Chen, Xiaofen Xing, Weibin Zhang, Weidong Chen, Xiangmin Xu

摘要:

语音情感识别是人机交互的关键。代表不同情绪的时间区域局部地分散在语音的不同部分中。此外,重要信息的时间尺度可以在语音段内和跨语音段的大范围内变化。虽然基于变换的模型在这一领域取得了进展,现有的模型不能精确地定位在不同的时间尺度上的重要区域。为了解决这个问题,我们提出了动态窗口Transformer(DWFormer),一个新的架构,利用时间的重要性,通过动态分割样本到窗口。自注意力机制应用于窗口中,以细粒度的方式局部捕获时间重要信息。跨窗口的信息交互也被考虑到全球传播。DWFormer在IEMOCAP和MELD数据集上进行评估。实验结果表明,该模型取得了更好的性能比以前的国家的最先进的方法。

英文摘要:

Speech emotion recognition is crucial to human-computer interaction. The temporal regions that represent different emotions scatter in different parts of the speech locally. Moreover, the temporal scales of important information may vary over a large range within and across speech segments. Although transformer-based models have made progress in this field, the existing models could not precisely locate important regions at different temporal scales. To address the issue, we propose Dynamic Window transFormer (DWFormer), a new architecture that leverages temporal importance by dynamically splitting samples into windows. Self-attention mechanism is applied within windows for capturing temporal important information locally in a fine-grained way. Cross-window information interaction is also taken into account for global communication. DWFormer is evaluated on both the IEMOCAP and the MELD datasets. Experimental results show that the proposed model achieves better performance than the previous state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑