arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.00305cs.CRcs.AIcs.LG

保持语义的LLM漏洞检测器逃避

Semantics-Preserving Evasion of LLM Vulnerability Detectors

Northeastern University(东北大学);University of Pennsylvania(宾夕法尼亚大学)

Luze Sun, Alina Oprea, Eric Wong

AI总结:

研究发现基于LLM的漏洞检测器在保持语义的逃避攻击下存在系统性失效,提出联合鲁棒性指标以评估检测器的鲁棒性。

摘要:

基于LLM的漏洞检测器越来越多地应用于安全关键的代码审查,但其在行为保持编辑下的鲁棒性仍缺乏深入理解。我们通过在统一的C/C++基准(N=5000)上实例化多样的行为保持代码转换,评估检测时间的完整性在语义保持威胁模型下的表现,并引入了跨不同攻击方法/载体的联合鲁棒性指标。在不同模型中,我们观察到语义不变对抗转换的系统性失效:即使是最先进的漏洞检测器在干净输入上表现良好,但在行为等效编辑下预测会翻转。针对单个替代模型优化的通用对抗字符串在转移到黑盒API时仍有效,且梯度访问可以进一步放大逃避的成功率。这些结果表明,即使高性能的检测器也容易受到低成本、保持语义的逃避攻击。我们的基于载体的指标为评估基于LLM的代码检测器提供了实用的诊断。

英文摘要:

LLM-based vulnerability detectors are increasingly deployed in security-critical code review, yet their resilience to evasion under behavior-preserving edits remains poorly understood. We evaluate detection-time integrity under a semantics-preserving threat model by instantiating diverse behavior-preserving code transformations on a unified C/C++ benchmark (N=5000), and introduce a metric of joint robustness across different attack methods/carriers. Across models, we observe a systemic failure of semantic invariant adversarial transformations: even state-of-the-art vulnerability detectors perform well on clean inputs while predictions flip under behavior-equivalent edits. Universal adversarial strings optimized on a single surrogate model remain effective when transferred to black-box APIs, and gradient access can further amplify evasion success. These results show that even high-performing detectors are vulnerable to low-cost, semantics-preserving evasion. Our carrier-based metrics provide practical diagnostics for evaluating LLM-based code detectors.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑