arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2112.12792cs.LGcs.MM
收藏

理解和测量多模态学习的鲁棒性

Understanding and Measuring Robustness of Multimodal Learning

Computer Science and Engineering, University at Buffalo(纽约州立大学布法罗分校计算机科学与工程系);School of Computing, Clemson University(克莱姆森大学计算学院)

Nishant Vishwamitra, Hongxin Hu, Ziming Zhao, Long Cheng, Feng Luo

摘要:

现代数字世界正日益变得多模式化。虽然多模态学习最近已经彻底改变了多模态任务的最新性能,但对多模态学习在对抗环境中的鲁棒性知之甚少。在本文中,我们通过一个名为MUROAN(多模态鲁棒性分析器)的框架,通过关注多模态模型中输入模态的融合,介绍了多模态学习的对抗鲁棒性的全面测量。我们首先提出了一个统一的看法,多模态模型在MUROAN和识别的融合机制的多模态模型作为一个关键的漏洞。然后,我们介绍了一种新型的多模态对抗攻击称为解耦攻击的MUROAN,其目的是妥协的多模态模型解耦融合的方式。我们利用MUROAN的解耦攻击来测量几个最先进的多模态模型,发现所有这些模型中的多模态融合机制都容易受到解耦攻击。我们特别证明,在最坏的情况下,MUROAN的解耦攻击实现了100%的攻击成功率,解耦输入空间的1.16%。最后,我们证明了传统的对抗性训练不足以提高多模态模型对解耦攻击的鲁棒性。我们希望我们的研究结果能鼓励研究人员追求提高多模态学习的鲁棒性。

英文摘要:

The modern digital world is increasingly becoming multimodal. Although multimodal learning has recently revolutionized the state-of-the-art performance in multimodal tasks, relatively little is known about the robustness of multimodal learning in an adversarial setting. In this paper, we introduce a comprehensive measurement of the adversarial robustness of multimodal learning by focusing on the fusion of input modalities in multimodal models, via a framework called MUROAN (MUltimodal RObustness ANalyzer). We first present a unified view of multimodal models in MUROAN and identify the fusion mechanism of multimodal models as a key vulnerability. We then introduce a new type of multimodal adversarial attacks called decoupling attack in MUROAN that aims to compromise multimodal models by decoupling their fused modalities. We leverage the decoupling attack of MUROAN to measure several state-of-the-art multimodal models and find that the multimodal fusion mechanism in all these models is vulnerable to decoupling attacks. We especially demonstrate that, in the worst case, the decoupling attack of MUROAN achieves an attack success rate of 100% by decoupling just 1.16% of the input space. Finally, we show that traditional adversarial training is insufficient to improve the robustness of multimodal models with respect to decoupling attacks. We hope our findings encourage researchers to pursue improving the robustness of multimodal learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑