Emotional Reaction Intensity(ERI) estimation is an important task in multimodal scenarios, and has fundamental applications in medicine, safe driving and other fields. In this paper, we propose a solution to the ERI challenge of the fifth Affective Behavior Analysis in-the-wild(ABAW), a dual-branch based multi-output regression model. The spatial attention is used to better extract visual features, and the Mel-Frequency Cepstral Coefficients technology extracts acoustic features, and a method named modality dropout is added to fusion multimodal features. Our method achieves excellent results on the official validation set.
Universidad de Buenos Aires(布宜诺斯艾利斯大学);Universidade Federal do Rio Grande do Norte(北里奥格兰德联邦大学);Universidade Federal de Pernambuco(伯南布哥联邦大学);Universidad Torcuato Di Tella(托尔夸托·迪·特利亚大学);IBM(国际商业机器公司)
Evaluating Large Language Models Against Human Annotators in Latent Content Analysis: Sentiment, Political Leaning, Emotional Intensity, and Sarcasm
Institute for Artificial Intelligence Research and Development of Serbia(塞尔维亚人工智能研究与发展研究所);University of Belgrade(贝尔格莱德大学);Institute for Philosophy and Social Theory(哲学与社会理论研究所);Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau (RPTU)(莱茵兰-普法尔茨州 Kaiserslautern-Landau 应用科技大学);German Research Centre for Artificial Intelligence (DFKI)(德国人工智能研究中心);Vilnius Gediminas Technical University(维尔纽斯格迪米纳斯技术大学);Drexel University(德雷塞尔大学);University of Montenegro(黑山大学);Faculty of Dramatic Arts(戏剧艺术学院);University of Kragujevac(克拉古耶瓦茨大学);Faculty of Engineering(工程学院)
The Emotional Baby Is Truly Deadly: Does your Multimodal Large Reasoning Model Have Emotional Flattery towards Humans?
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);Nanyang Technological University(南洋理工大学);University of Chinese Academy of Sciences(中国科学院大学)
Expressive Prompting: Improving Emotion Intensity and Speaker Consistency in Zero-Shot TTS
Tianjin Key Laboratory of Cognitive Computing and Application, College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部认知计算与应用天津市重点实验室);Kuaishou Technology Co., Ltd(快手科技有限公司);Institute of Artificial Intelligence, China Telecom(中国电信人工智能研究院);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Huiyan Technology (Tianjin) Co., Ltd(慧眼科技(天津)有限公司)