arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1903.12424cs.CLcs.LG
收藏

基于注意增强的端到端多任务学习的语音情感预测

Attention-Augmented End-to-End Multi-Task Learning for Emotion Prediction from Speech

Imperial College London(帝国理工学院);audEERING GmbH(audEERING有限公司);University of Augsburg(奥格斯堡大学)

Zixing Zhang, Bingwen Wu, Bjoern Schuller

摘要:

尽管对用于语音情感识别的端到端学习系统的研究兴趣日益增加,但是传统系统或者部分地由于有限的训练数据而遭受过拟合,或者没有明确地考虑针对特定任务的自动学习的表示的不同贡献。在这方面的贡献,我们提出了一个新的端到端的框架,这是通过学习其他辅助任务和注意力机制增强。也就是说,我们联合训练具有若干不同但相关的情感预测任务的端到端网络,即,唤醒、效价和优势预测,以提取比传统系统更鲁棒的在各种任务之间共享的表示,希望它能够缓解过拟合问题。同时,在每个任务的层之上实现注意力层,目的是捕获每个单独任务的不同片段部分的贡献分布。为了评估所提出的系统的有效性,我们进行了广泛使用的数据库IEMOCAP一组实验。实证结果表明,所提出的系统显着优于相应的基线系统。

英文摘要:

Despite the increasing research interest in end-to-end learning systems for speech emotion recognition, conventional systems either suffer from the overfitting due in part to the limited training data, or do not explicitly consider the different contributions of automatically learnt representations for a specific task. In this contribution, we propose a novel end-to-end framework which is enhanced by learning other auxiliary tasks and an attention mechanism. That is, we jointly train an end-to-end network with several different but related emotion prediction tasks, i.e., arousal, valence, and dominance predictions, to extract more robust representations shared among various tasks than traditional systems with the hope that it is able to relieve the overfitting problem. Meanwhile, an attention layer is implemented on top of the layers for each task, with the aim to capture the contribution distribution of different segment parts for each individual task. To evaluate the effectiveness of the proposed system, we conducted a set of experiments on the widely used database IEMOCAP. The empirical results show that the proposed systems significantly outperform corresponding baseline systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑