EMOVOME: A Dataset for Emotion Recognition in Spontaneous Real-Life Speech
Lucía Gómez-Zaragozá, Rocío del Amor, María José Castro-Bleda, Valery Naranjo, Mariano Alcañiz Raya, Javier Marín-Morales
备注：
This article is a merged version of the description of the EMOVOME database in arXiv:2402.17496v1 and the speech emotion recognition models in arXiv:2403.02167v1. This work has been submitted to the IEEE for possible publication
Spontaneous datasets for Speech Emotion Recognition (SER) are scarce and frequently derived from laboratory environments or staged scenarios, such as TV shows, limiting their application in real-world contexts. We developed and publicly released the Emotional Voice Messages (EMOVOME) dataset, including 999 voice messages from real conversations of 100 Spanish speakers on a messaging app, labeled in continuous and discrete emotions by expert and non-expert annotators. We evaluated speaker-independent SER models using acoustic features as baseline and transformer-based models. We compared the results with reference datasets including acted and elicited speech, and analyzed the influence of annotators and gender fairness. The pre-trained UniSpeech-SAT-Large model achieved the highest results, 61.64% and 55.57% Unweighted Accuracy (UA) for 3-class valence and arousal prediction respectively on EMOVOME, a 10% improvement over baseline models. For the emotion categories, 42.58% UA was obtained. EMOVOME performed lower than the acted RAVDESS dataset. The elicited IEMOCAP dataset also outperformed EMOVOME in predicting emotion categories, while similar results were obtained in valence and arousal. EMOVOME outcomes varied with annotator labels, showing better results and fairness when combining expert and non-expert annotations. This study highlights the gap between controlled and real-life scenarios, supporting further advancements in recognizing genuine emotions.
iMiGUE-Speech: A Spontaneous Speech Dataset for Affective Analysis
Center for Machine Vision and Signal Analysis, University of Oulu, Finland（机器视觉与信号分析中心，奥卢大学，芬兰）；Center for Machine Vision（机器视觉中心）；Signal Analysis, University of Oulu, Finland（信号分析，奥卢大学，芬兰）
The MuSe 2022 Multimodal Sentiment Analysis Challenge: Humor, Emotional Reactions, and Stress
University of Augsburg（奥格斯堡大学）；Hume AI（休谟人工智能）；University of Passau（帕绍大学）；Recoro；University of Ulm（乌尔姆大学）；Nanyang Technological University（南洋理工大学）；Imperial College London（伦敦帝国理工学院）
Enhancing Speech Emotion Recognition with Graph-Based Multimodal Fusion and Prosodic Features for the Speech Emotion Recognition in Naturalistic Conditions Challenge at Interspeech 2025
Federal University of Goiás（戈亚斯联邦大学）；Federal University of Rio Grande do Norte（北里奥格兰德联邦大学）；Aeronautics Institute of Technology（航空技术研究所）；Federal University of Mato Grosso（马托格罗索联邦大学）
本文面向 INTERSPEECH 2025 自然条件语音情感识别挑战赛，提出结合先进音频模型、韵律与频谱增强文本特征、F0 量化和集成学习的鲁棒系统，并验证图注意力网络融合有效性，测试集 Macro F1 达 39.79%。
Crab: Multi Layer Contrastive Supervision to Improve Speech Emotion Recognition Under Both Acted and Natural Speech Condition
Dept. of Computer Engineering and Automation (DCA), Faculdade de Engenharia Elétrica e de Computação（计算机工程与自动化系（DCA）、电气与计算机工程学院）；AI Lab.（人工智能实验室）；Institute of Computing, Universidade Estadual de Campinas, UNICAMP（计算学院，坎皮纳斯州立大学，UNICAMP）
The MuSe 2023 Multimodal Sentiment Analysis Challenge: Mimicked Emotions, Cross-Cultural Humour, and Personalisation
University of Augsburg（奥格斯堡大学）；Hume AI（休谟人工智能公司）；University of Passau（帕绍大学）；University of Ulm（乌尔姆大学）；Nanyang Technological University（南洋理工大学）；Imperial College London（帝国理工学院）
EM2LDL: A Multilingual Speech Corpus for Mixed Emotion Recognition through Label Distribution Learning
Faculty of Data Science, City University of Macau（数据科学学院，澳门城市大学）；Graduate School of Informatics, Nagoya University（信息科学研究生院，名古屋大学）；Institute of Psychology, Chinese Academy of Sciences（心理学研究所，中国科学院）；Information Technology Center, Nagoya University（信息科技中心，名古屋大学）；Graduate School of Advanced Science and Technology, Japan Advanced Institute of Science and Technology（先进科学与技术研究生院，日本科学技术大学）
Smile on the Face, Sadness in the Eyes: Bridging the Emotion Gap with a Multimodal Dataset of Eye and Facial Behaviors
School of Computer Science, China University of Geosciences (Wuhan)（中国地质大学（武汉）计算机科学学院）；School of Software Engineering, Huazhong University of Science and Technology（华中科技大学软件工程学院）；School of Computer Science, Wuhan University（武汉大学计算机科学学院）；School of Computing, Engineering and Mathematical Sciences, La Trobe University（拉筹伯大学计算科学、工程与数学科学学院）
NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset for Voice Conversion
Department of Electrical and Computer Engineering, University of Texas at Dallas（德克萨斯大学达拉斯分校电气与计算机工程系）；Department of Electrical and Computer Engineering, Johns Hopkins University（约翰霍普金斯大学电气与计算机工程系）；ARRAY Innovation（ARRAY创新）；Language Technologies Institute, Carnegie Mellon University（卡内基梅隆大学语言技术研究所）
Toward using Speech to Sense Student Emotion in Remote Learning Environments
Idiap Research Institute（伊迪亚普研究所）；Lausanne University Hospital and University of Lausanne（洛桑大学医院和洛桑大学）；The Sense Innovation and Research Center（Sense创新与研究中心）；FFHS: Swiss Distance University of Applied Sciences（瑞士远程应用科学大学）
Multi-class versus One-class classifier in spontaneous speech analysis oriented to Alzheimer Disease diagnosis
Universidad del País Vasco/Euskal Herriko Unibertsitatea（巴斯克大学）；Fundació Tecnocampus（Tecnocampus基金会）；University of Vic – Central University of Catalonia（维克大学-加泰罗尼亚中央大学）；Universidad de Las Palmas de Gran Canaria（拉斯帕尔马斯大加那利大学）；Brn GuABIAN, Association for Personal Autonomy（GuABIAN 个人自主协会）
