arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2605.18915cs.CRcs.AI

DMN: 一种用于多图像输入多模态大语言模型的组合框架

DMN: A Compositional Framework for Jailbreaking Multimodal LLMs with Multi-Image Inputs

AI Security Lab(360人工智能安全实验室);International Computer Science Institute(国际计算机科学研究所);UC Berkeley(加州大学伯克利分校);Beihang University(北航大学)

Wenzhuo Xu, Zhipeng Wei, Zonghao Ying, Deyue Zhang, Dongdong Yang, Xiangzheng Zhang, Quanchen Zou

AI总结:

本文提出DMN框架,通过分布式指令、多模态证据和数字链任务,提升多图像输入多模态大语言模型的 jailbreak 性能,实验表明其在GPT-4o、Gemini-2.5-pro和Claude Sonnet 4上的攻击成功率超过90%。

摘要:

多模态大语言模型(MLLMs)易受jailbreak攻击,此类攻击可引发有害响应。许多MLLMs支持多图像输入,但因对多图像安全对齐的重视不足,无意中引入了新的漏洞。先前的MLLM jailbreak方法仅使用单张图像,限制了攻击空间:无法将有害请求分散到多个图像中、承载丰富信息或利用额外的视觉推理任务来分散MLLMs。为了解决这些限制,本文提出了一种组合jailbreak框架,DMN,利用分布式指令、多模态证据和数字链任务来全面提升jailbreak性能。大量实验表明,DMN在MLLM jailbreaking中表现优异,例如在GPT-4o、Gemini-2.5-pro和Claude Sonnet 4上的攻击成功率超过90%,远超其他基线方法。这种组合、多图像jailbreak策略揭示了其安全机制的根本性弱点。

英文摘要:

Multimodal Large Language Models (MLLMs) are vulnerable to jailbreak attacks, which can elicit harmful responses from MLLMs. Many MLLMs support multi-image inputs, inadvertently introducing new vulnerabilities due to less efforts on multi-image safety alignment. Previous MLLM jailbreak methods only uses a single image, which restricts the attack space: they cannot distribute harmful requests across multiple images, carry abundant information, or exploit additional visual reasoning tasks to distract MLLMs. To address these limitations, in this paper, we propose a compositional jailbreak framework, \textbf{DMN}, which leverages \textbf{D}istributed instruction, \textbf{M}ultimodal evidence and a \textbf{N}umber chain task to fully enhance the jailbreak performance. Extensive experiments show that DMN is highly effective for MLLM jailbreaking, e.g. achieving attack success rates of over 90\% on GPT-4o, Gemini-2.5-pro and Claude Sonnet 4, surpassing other baselines by a large margin. This compositional, multi-image jailbreak strategy reveals fundamental weaknesses in their safety mechanisms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑