arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.08650cs.SDcs.CVcs.LGeess.AS
收藏

高斯平滑不平衡数据提高语音情感识别

Gaussian-smoothed Imbalance Data Improves Speech Emotion Recognition

Xidian University(西安电子科技大学);Pazhou Lab(琶洲实验室)

Xuefeng Liang, Hexin Jiang, Wenxin Xu, Ying Zhou

摘要:

在语音情感识别任务中,模型从数据集中学习情感表示。我们发现IEMOCAP数据集中的数据分布非常不平衡,这可能会损害模型学习更好的表示。为了解决这个问题,我们提出了一种新的成对情感数据分布平滑(PDDS)方法。PDDS认为情感数据的分布在现实中应该是平滑的,然后对情感对进行高斯平滑,构造一个分布更平滑的新训练集。所需的新数据使用混合扩增进行补充。由于PDDS是模型和模态不可知的,因此在IEMOCAP数据集上使用三个SOTA模型进行评估。实验结果表明,在WA和UA方面,这两种模型分别提高了0.2%~ 4.8%和1.5%~ 5.9%.此外,消融研究表明,PDDS的关键优势是合理的数据分布,而不是简单的数据增强。

英文摘要:

In speech emotion recognition tasks, models learn emotional representations from datasets. We find the data distribution in the IEMOCAP dataset is very imbalanced, which may harm models to learn a better representation. To address this issue, we propose a novel Pairwise-emotion Data Distribution Smoothing (PDDS) method. PDDS considers that the distribution of emotional data should be smooth in reality, then applies Gaussian smoothing to emotion-pairs for constructing a new training set with a smoother distribution. The required new data are complemented using the mixup augmentation. As PDDS is model and modality agnostic, it is evaluated with three SOTA models on the IEMOCAP dataset. The experimental results show that these models are improved by 0.2\% - 4.8\% and 1.5\% - 5.9\% in terms of WA and UA. In addition, an ablation study demonstrates that the key advantage of PDDS is the reasonable data distribution rather than a simple data augmentation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑