arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.09024cs.CVcs.AIcs.CRcs.LG
收藏

别让我看图片:通过视觉提示注入防止多模态大语言模型分析图片

Leave My Images Alone: Preventing Multi-Modal Large Language Models from Analyzing Images via Visual Prompt Injection

Georgia Institute of Technology(佐治亚理工学院);Duke University(杜克大学)

Zedian Shao, Hongbin Liu, Yuepeng Hu, Neil Zhenqiang Gong

AI总结:

本文提出ImageProtector,通过在图像中嵌入精心设计的微小扰动,使多模态大语言模型在分析时产生拒绝响应,同时评估了三种潜在的防御措施,发现它们在降低ImageProtector效果的同时影响模型性能。

摘要:

多模态大语言模型(MLLMs)已发展为分析互联网级图像数据的强大工具,尽管提供了显著效益,但也引发关键安全和社会关切。特别是开放权重的MLLMs可能被滥用,从个人图像中大规模提取敏感信息,如身份、位置或其他私人细节。在本文中,我们提出了ImageProtector,一种用户端方法,通过在共享前嵌入精心设计的几乎不可察觉的扰动,作为对MLLMs的视觉提示注入攻击。结果,当攻击者使用MLLMs分析受保护的图像时,MLLMs会被一致诱导生成拒绝响应,如“对不起,我无法帮助您完成此请求。”我们通过六个MLLMs和四个数据集实证展示了ImageProtector的有效性。此外,我们评估了三种潜在的防御措施,高斯噪声、DiffPure和对抗训练,发现虽然它们部分减轻了ImageProtector的影响,但同时会降低模型的准确性和/或效率。我们的研究聚焦于开放权重MLLMs和大规模自动化图像分析的实用重要场景,并突显了基于扰动的隐私保护的潜力和局限性。

英文摘要:

Multi-modal large language models (MLLMs) have emerged as powerful tools for analyzing Internet-scale image data, offering significant benefits but also raising critical safety and societal concerns. In particular, open-weight MLLMs may be misused to extract sensitive information from personal images at scale, such as identities, locations, or other private details. In this work, we propose ImageProtector, a user-side method that proactively protects images before sharing by embedding a carefully crafted, nearly imperceptible perturbation that acts as a visual prompt injection attack on MLLMs. As a result, when an adversary analyzes a protected image with an MLLM, the MLLM is consistently induced to generate a refusal response such as "I'm sorry, I can't help with that request." We empirically demonstrate the effectiveness of ImageProtector across six MLLMs and four datasets. Additionally, we evaluate three potential countermeasures, Gaussian noise, DiffPure, and adversarial training, and show that while they partially mitigate the impact of ImageProtector, they simultaneously degrade model accuracy and/or efficiency. Our study focuses on the practically important setting of open-weight MLLMs and large-scale automated image analysis, and highlights both the promise and the limitations of perturbation-based privacy protection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑