arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.02482cs.LGcs.CLcs.CVcs.SDeess.AS

MUSE:一种面向多模态统一安全评估的运行导向平台

MUSE: A Run-Centric Platform for Multimodal Unified Safety Evaluation of Large Language Models

Duke University(杜克大学);Virtue AI

Zhongxi Wang, Yueqian Lin, Jingyang Zhang, Zinuo Cheng, Hai Helen Li, Yiran Chen

AI总结:

MUSE提出一种多模态统一安全评估平台,通过多轮攻击和跨轮模态切换技术,评估大型语言模型在不同模态下的安全性能。

摘要:

大型语言模型的安全评估和红队测试仍然主要以文本为中心,现有框架缺乏系统测试对齐性是否能推广到音频、图像和视频输入的基础设施。我们提出了MUSE(多模态统一安全评估),一个开源的运行导向平台,整合了自动跨模态负载生成、三种多轮攻击算法(Crescendo、PAIR、Violent Durian)、无提供商偏见的模型路由和具有五级安全分类的LLM裁判器,整合到一个浏览器系统中。双指标框架区分了硬攻击成功率(仅合规)和软ASR(包括部分合规),捕捉二元指标所遗漏的部分信息泄露。为了探测对齐性是否能跨模态边界推广,我们引入了跨轮模态切换(ITMS),通过每轮模态旋转增强多轮攻击。在六个多模态LLM上进行实验,来自四个提供商的模型显示,多轮策略可达到对近完美单轮拒绝模型的90-100% ASR。ITMS在已饱和的基线模型上并未普遍提高最终ASR,但通过破坏早期轮次防御加速了收敛,消融研究揭示模态效应的方向是模型家族特定而非普遍的,凸显了需要提供商意识的跨模态安全测试的必要性。

英文摘要:

Safety evaluation of multimodal large language models requires tracking not only whether an attack succeeds, but also how the interaction unfolds across turns and input modalities. We present MUSE (Multimodal Unified Safety Evaluation), an open-source, browser-based, run-centric platform for multimodal safety evaluation. MUSE treats each attack run as the persistent unit of execution, inspection, and analysis, preserving its configuration, multi-turn trajectory, delivered modalities and media, target responses, and safety judgments. A five-level response taxonomy further distinguishes full Compliance from Partial Compliance and refusal behavior, yielding hard ASR, soft ASR, and gray-zone width (GZW). Across 11,700 evaluations on six multimodal LLMs, direct text-only requests yield only 3.1% macro hard ASR and 4.4% soft ASR, while iterative attack procedures are substantially more effective. Attack effectiveness also varies substantially with the attacker backbone. In contrast, Inter-Turn Modality Switching (ITMS), evaluated as a controlled delivery-modality probe, does not consistently increase attack success. These results demonstrate the value of run-centric, fine-grained evaluation for characterizing multimodal safety behavior beyond a single binary success metric.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑