arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.13484cs.MM
收藏

Robust-MSA:了解模态噪声对多模态情感分析的影响

Robust-MSA: Understanding the Impact of Modality Noise on Multimodal Sentiment Analysis

Huisheng Mao, Baozheng Zhang, Hua Xu, Ziqi Yuan, Yihe Liu

摘要:

提高模型对模态噪声的鲁棒性,作为使多模态模型适应实际应用的重要步骤,越来越受到研究者的关注。对于多模态情感分析(MSA),也有一个争论是否多模态模型是更有效地对抗噪声功能比单峰的。强调直观的说明和深入分析这些问题,我们提出了Robust-MSA,这是一个交互式平台,可以可视化模态噪声的影响以及简单的防御方法,以帮助研究人员更好地了解他们的模型如何使用不完美的真实世界数据。

英文摘要:

Improving model robustness against potential modality noise, as an essential step for adapting multimodal models to real-world applications, has received increasing attention among researchers. For Multimodal Sentiment Analysis (MSA), there is also a debate on whether multimodal models are more effective against noisy features than unimodal ones. Stressing on intuitive illustration and in-depth analysis of these concerns, we present Robust-MSA, an interactive platform that visualizes the impact of modality noise as well as simple defence methods to help researchers know better about how their models perform with imperfect real-world data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑