arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2605.26409cs.CRcs.AIcs.LG
收藏

通过模型的行为几何进行越狱易感性预测与缓解

Jailbreak susceptibility prediction and mitigation via the behavioral geometry of models

Microsoft Research(微软研究院)

Hayden Helm, Xiaodong Liu, Weiwei Yang

AI总结:

本文通过形式化模型群体的行为几何,利用已评估和防御的模型,实现高效的易感性预测和防御迁移,在79个模型和100个系统配置上,易感性检测AUPRC达0.94且探针减少约98%,防御迁移性能优于同供应商分配。

摘要:

评估和缓解生成系统对越狱攻击的易感性对其安全部署至关重要。由于可部署系统的数量众多,对每种配置进行全面评估和优化是不切实际的。本文形式化了模型群体的行为几何,通过利用先前评估和防御过的模型,支持群体内高效的易感性预测和有效的防御迁移。我们将该框架应用于涵盖24个提供商的79个模型以及单个基础模型的100个系统配置。使用行为几何的简单方法在易感性检测中达到了0.94的AUPRC,与全面评估相比,探针数量减少了约98%。使用行为几何选择从哪个模型迁移优化后的防御,在无额外探针成本的情况下优于同供应商分配(+2%,p = 0.03),且一组三个模型足以覆盖整个群体。结果对超参数选择和评判者具有鲁棒性。

英文摘要:

Evaluating and mitigating a generative system's susceptibility to jailbreak attacks is critical to its safe deployment. Given the number of deployable systems, full per-configuration evaluation and optimization is impractical. In this paper, we formalize the behavioral geometry of a population of models that, by leveraging previously evaluated and defended models, supports both efficient susceptibility prediction and effective defense transfer across a population. We apply the framework to 82 models spanning 24 providers and to 100 system configurations of a single base model. Simple methods that use the behavioral geometry reach an AUPRC of $0.94$ for susceptibility detection with $\approx98\%$ fewer probes relative to a full evaluation. Using the behavioral geometry to select which model to transfer an optimized defense from outperforms same-provider assignment ($+4.1\%$, $p = 0.004$) at no additional probe cost, with a set of three models sufficient to cover the population. Results are robust to hyperparameter selection and judge.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑