arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.01784cs.CRcs.AI
收藏

基于结构对抗进化的多模态对齐

Co-Evolutionary Multi-Modal Alignment via Structured Adversarial Evolution

Nanyang Technological University(南洋理工大学);Tsinghua University(清华大学)

Guoxin Shi, Haoyu Wang, Zaihui Yang, Yuxing Wang, Yongzhe Chang

AI总结:

本文提出CEMA框架,通过共进化对抗提升多模态对齐的鲁棒性和安全性。

摘要:

对抗行为在将大型语言模型对齐到人类价值观方面起着核心作用。然而,现有对齐方法大多依赖于静态对抗设置,这从根本上限制了鲁棒性,特别是在具有更大攻击面的多模态设置中。在本工作中,我们超越了静态对抗监督,引入了共进化对齐,通过演化的攻击进行实例化,即CEMA(共进化多模态对齐),一种自动化和适应性的多模态安全对齐框架。我们引入了一个进化攻击者,将对抗性提示分解为方法模板和有害意图。通过使用突变、交叉和差分进化等遗传算子,它使简单的种子攻击能够继承复杂 jailbreak 的结构有效性。适应性防御者在合成的困难负样本上迭代更新,形成一个闭环过程,使对齐适应于演化的攻击。实验表明,进化攻击者显著提高了红队 jailbreak 攻击成功率(ASR),而适应性防御者在多个基准上提高了鲁棒性和泛化能力,具有更高的数据效率,不引起过多的良性拒绝,并且与推理时间防御如 AdaShield 兼容。

英文摘要:

Adversarial behavior plays a central role in aligning large language models with human values. However, existing alignment methods largely rely on static adversarial settings, which fundamentally limit robustness, particularly in multimodal settings with a larger attack surface. In this work, we move beyond static adversarial supervision and introduce co-evolutionary alignment with evolving attacks, instantiated by CEMMA (Co-Evolutionary Multi-Modal Alignment), an automated and adaptive framework for multimodal safety alignment. We introduce an Evolutionary Attacker that decomposes adversarial prompts into method templates and harmful intents. By employing genetic operators, including mutation, crossover, and differential evolution, it enables simple seed attacks to inherit the structural efficacy of sophisticated jailbreaks. The Adaptive Defender is iteratively updated on the synthesized hard negatives, forming a closed-loop process that adapts alignment to evolving attacks. Experiments show that the Evolutionary Attacker substantially increases red-teaming jailbreak attack success rate (ASR), while the Adaptive Defender improves robustness and generalization across benchmarks with higher data efficiency, without inducing excessive benign refusal, and remains compatible with inference-time defenses such as AdaShield.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑