arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.07052cs.LG
收藏

通过微调预训练模型和超参数优化增强语音情感识别

Enhancing Speech Emotion Recognition via Fine-Tuning Pre-Trained Models and Hyper-Parameter Optimisation

Aryan Golbaghi, Shuo Zhou

AI总结:

本研究提出结合预训练模型与自动超参数优化的语音情感识别流程,在CPU上高效达到高准确率,并显著提升跨语言零样本泛化能力。

摘要:

我们提出了一种语音情感识别(SER)的工作流程,该流程将预训练表示与自动超参数优化(HPO)相结合。使用在IEMOCAP上微调的SpeechBrain wav2vec2-base模型作为编码器,我们在相同的四维搜索空间和15次试验预算下,比较了两种HPO策略:高斯过程贝叶斯优化(GP-BO)和树结构帕森估计器(TPE),以德语EmoDB语料库上的平衡类别准确率(BCA)作为目标。所有实验在8个CPU核心和32 GB RAM上运行。GP-BO在11分钟内达到0.96的BCA,而TPE(Hyperopt实现)在15分钟内达到0.97。相比之下,网格搜索需要143次试验和1,680分钟才能超过0.9的BCA,而AutoSpeech 2020的最佳基线在GPU上30分钟内仅报告0.85。对于跨语言泛化,一个在EmoDB上训练并经过HPO调优的模型在CREMA-D上将零样本准确率提高了0.25,在RAVDESS上提高了0.26。结果表明,使用预训练编码器的高效HPO在普通CPU上即可实现具有竞争力的SER。本工作的源代码可在以下网址获取:https://github.com/youngaryan/speechbrain-emotion-hpo。

英文摘要:

We propose a workflow for speech emotion recognition (SER) that combines pre-trained representations with automated hyperparameter optimisation (HPO). Using SpeechBrain wav2vec2-base model fine-tuned on IEMOCAP as the encoder, we compare two HPO strategies, Gaussian Process Bayesian Optimisation (GP-BO) and Tree-structured Parzen Estimators (TPE), under an identical four-dimensional search space and 15-trial budget, with balanced class accuracy (BCA) on the German EmoDB corpus as the objective. All experiments run on 8 CPU cores with 32 GB RAM. GP-BO achieves 0.96 BCA in 11 minutes, and TPE (Hyperopt implementation) attains 0.97 in 15 minutes. In contrast, grid search requires 143 trials and 1,680 minutes to exceed 0.9 BCA, and the best AutoSpeech 2020 baseline reports only 0.85 in 30 minutes on GPU. For cross-lingual generalisation, an EmoDB-trained HPO-tuned model improves zero-shot accuracy by 0.25 on CREMA-D and 0.26 on RAVDESS. Results show that efficient HPO with pre-trained encoders delivers competitive SER on commodity CPUs. Source code to this work is available at: https://github.com/youngaryan/speechbrain-emotion-hpo.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑