arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2208.09830cs.SDcs.LGeess.AS
收藏

基于图神经网络的表示学习语音情感识别

Representation Learning with Graph Neural Networks for Speech Emotion Recognition

Dongguk University(东国大学)

Junghun Kim, Jihie Kim

摘要:

学习表达性表示在深度学习中至关重要。在语音情感识别中,语音中的真空区域或噪声干扰表达性表示学习。然而,传统的基于RNN的模型容易受到这种噪声的影响。最近,图神经网络(GNN)已被证明是有效的表示学习,我们采用这种框架的SER。特别是,我们提出了一个基于余弦相似性的图作为一个理想的图结构的表示学习在SER。我们提出了一个基于余弦相似性的图卷积网络(CoGCN),是强大的扰动和噪声。实验结果表明,我们的方法优于国家的最先进的方法,或提供有竞争力的结果与一个显着的模型大小减少只有1/30的参数。

英文摘要:

Learning expressive representation is crucial in deep learning. In speech emotion recognition (SER), vacuum regions or noises in the speech interfere with expressive representation learning. However, traditional RNN-based models are susceptible to such noise. Recently, Graph Neural Network (GNN) has demonstrated its effectiveness for representation learning, and we adopt this framework for SER. In particular, we propose a cosine similarity-based graph as an ideal graph structure for representation learning in SER. We present a Cosine similarity-based Graph Convolutional Network (CoGCN) that is robust to perturbation and noise. Experimental results show that our method outperforms state-of-the-art methods or provides competitive results with a significant model size reduction with only 1/30 parameters.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑