arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.04894cs.CRcs.AI
收藏

从黑盒LLM生成的软件中提取重复漏洞

Extracting Recurring Vulnerabilities from Black-Box LLM-Generated Software

Technion - Israel Institute of Technology(技术学院 - 以色列理工学院)

Tomer Kordonsky, Amit LeVi, Maayan Yamin, Noam Benzimra, Avi Mendelson

AI总结:

提出特征-安全表(FSTab),通过黑盒攻击从前端特征预测后端漏洞,并量化模型跨程序、重述和领域的漏洞复现一致性,实验显示跨域攻击成功率高达94%。

摘要:

LLM越来越多地用于代码生成,但其输出通常遵循重复模板,可能导致可预测的漏洞。我们研究了LLM生成软件中的漏洞持久性,并引入了特征-安全表(FSTab),包含两个组件。首先,FSTab支持黑盒攻击,通过可观察的前端特征和源LLM的知识预测可能的后端漏洞,无需访问后端或源代码。其次,FSTab提供以模型为中心的评估,量化模型在跨程序、语义保持重述和应用域中复现相同漏洞的一致性。我们在最先进的代码LLM(包括GPT-5.2、Claude-4.5 Opus和Gemini-3 Pro)上评估了FSTab,覆盖多种应用域。我们的结果显示强大的跨域迁移:即使目标域在训练中被排除,FSTab在内部工具(Claude-4.5 Opus)上仍能达到94%的攻击成功率和93%的漏洞覆盖率。这些发现暴露了LLM生成软件中一个未被充分探索的攻击面,并凸显了代码生成的安全风险。我们的代码可在https://github.com/fstabicml2026/FSTab获取。

英文摘要:

LLMs are increasingly used for code generation, but their outputs often follow recurring templates that can induce predictable vulnerabilities. We study vulnerability persistence in LLM-generated software and introduce Feature--Security Table (FSTab) with two components. First, FSTab enables a black-box attack that predicts likely backend vulnerabilities from observable frontend features and knowledge of the source LLM, without access to the backend or source code. Second, FSTab provides a model-centric evaluation that quantifies how consistently a model reproduces the same vulnerabilities across programs, semantics-preserving rephrasings, and application domains. We evaluate FSTab on state-of-the-art code LLMs, including GPT-5.2, Claude-4.5 Opus, and Gemini-3 Pro, across diverse application domains. Our results show strong cross-domain transfer: even when the target domain is excluded from training, FSTab achieves up to 94% attack success and 93% vulnerability coverage on Internal Tools (Claude-4.5 Opus). These findings expose an underexplored attack surface in LLM-generated software and highlight the security risks of code generation. Our code is available at https://github.com/fstabicml2026/FSTab

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑