arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.08415cs.CVcs.AI
收藏

跨模态可迁移的图像到视频攻击视频质量度量

Cross-Modal Transferable Image-to-Video Attack on Video Quality Metrics

Lomonosov Moscow State University(罗蒙诺索夫莫斯科国立大学);ISP RAS Research Center for Trusted Artificial Intelligence(俄罗斯科学院信息与系统研究所在可信人工智能研究中心);MSU Institute for Artificial Intelligence(莫斯科大学人工智能研究所);Laboratory of Innovative Technologies for Processing Video Content(视频内容处理创新技术实验室)

Georgii Gotin, Ekaterina Shumitskaya, Anastasia Antsiferova, Dmitriy Vatolin

AI总结:

本文提出IC2VQA方法,通过跨模态攻击探索现代视频质量度量模型的漏洞,利用CLIP模块提升对抗扰动的可迁移性,实验显示在三种黑盒视频质量度量模型上攻击成功率高。

摘要:

最近的研究表明,现代图像和视频质量评估(IQA/VQA)度量标准对对抗攻击脆弱。攻击者可通过预处理操纵视频以根据特定度量标准人为提高其质量评分,尽管视觉质量无实际提升。文献中大多数攻击为白盒攻击,而VQA中的黑盒攻击研究较少。此外,一些研究指出在VQA中生成的对抗示例在应用到其他模型时缺乏可迁移性。本文提出跨模态攻击方法IC2VQA,旨在探索现代VQA模型的漏洞。该方法受观察启发,即图像和视频的低级特征空间相似。我们研究对抗扰动在不同模态间的可迁移性;具体而言,我们分析如何利用白盒IQA模型附加CLIP模块生成的对抗扰动有效攻击VQA模型。CLIP模块的加入作为有价值的辅助,因其能有效捕捉低级语义。大量实验表明,IC2VQA在攻击三种黑盒VQA模型时具有高成功率。我们与现有黑盒攻击策略进行比较,突出其在相同迭代次数和攻击强度下的优越性。我们认为所提出的方法将有助于深入分析鲁棒的VQA度量标准。

英文摘要:

Recent studies have revealed that modern image and video quality assessment (IQA/VQA) metrics are vulnerable to adversarial attacks. An attacker can manipulate a video through preprocessing to artificially increase its quality score according to a certain metric, despite no actual improvement in visual quality. Most of the attacks studied in the literature are white-box attacks, while black-box attacks in the context of VQA have received less attention. Moreover, some research indicates a lack of transferability of adversarial examples generated for one model to another when applied to VQA. In this paper, we propose a cross-modal attack method, IC2VQA, aimed at exploring the vulnerabilities of modern VQA models. This approach is motivated by the observation that the low-level feature spaces of images and videos are similar. We investigate the transferability of adversarial perturbations across different modalities; specifically, we analyze how adversarial perturbations generated on a white-box IQA model with an additional CLIP module can effectively target a VQA model. The addition of the CLIP module serves as a valuable aid in increasing transferability, as the CLIP model is known for its effective capture of low-level semantics. Extensive experiments demonstrate that IC2VQA achieves a high success rate in attacking three black-box VQA models. We compare our method with existing black-box attack strategies, highlighting its superiority in terms of attack success within the same number of iterations and levels of attack strength. We believe that the proposed method will contribute to the deeper analysis of robust VQA metrics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑