arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.06910cs.SE
收藏

PenForge: 为自动化渗透测试的实时专家代理构建

PenForge: On-the-Fly Expert Agent Construction for Automated Penetration Testing

Singapore Management University(新加坡国立大学);Monash University(蒙纳士大学)

Huihui Huang, Jieke Shi, Junkai Chen, Ting Zhang, Yikun Li, Chengran Yang, Eng Lieh Ouh, Lwin Khin Shar, David Lo

AI总结:

PenForge通过实时构建专家代理提升自动化渗透测试效果,实现零日设置中30%的利用成功率,比现有方法提高3倍。

摘要:

渗透测试对于在真实对手利用之前识别Web应用中的漏洞至关重要。最近的研究探索了使用大型语言模型(LLM)驱动的代理来自动化这一过程,但现有方法要么依赖于一个通用代理,在复杂场景中表现不佳,要么是专门针对特定漏洞类型的代理,无法适应多样化的漏洞类型。因此,我们引入了PenForge,一个在测试过程中动态构建专家代理的框架,而不是依赖预先准备的代理。通过将自动侦察潜在攻击面与根据上下文即时实例化的代理结合,PenForge在特别具有挑战性的零日设置中实现了30.0%的利用成功率(12/40),比当前最先进的方法提高了3倍。我们的分析还指出了三个未来工作的机会:(1)提供更丰富的工具使用知识以提高利用效果;(2)扩展基准测试以包含更多漏洞和攻击类型;(3)通过可解释机制和人工审查来培养开发者的信任。作为一项具有实质性潜在影响的新兴成果,PenForge体现了实时代理构建这一早期但具有变革性的想法,标志着其作为可扩展和有效LLM驱动渗透测试的一步。

英文摘要:

Penetration testing is essential for identifying vulnerabilities in web applications before real adversaries can exploit them. Recent work has explored automating this process with Large Language Model (LLM)-powered agents, but existing approaches either rely on a single generic agent that struggles in complex scenarios or narrowly specialized agents that cannot adapt to diverse vulnerability types. We therefore introduce PenForge, a framework that dynamically constructs expert agents during testing rather than relying on those prepared beforehand. By integrating automated reconnaissance of potential attack surfaces with agents instantiated on the fly for context-aware exploitation, PenForge achieves a 30.0% exploit success rate (12/40) on CVE-Bench in the particularly challenging zero-day setting, which is a 3 times improvement over the state-of-the-art. Our analysis also identifies three opportunities for future work: (1) supplying richer tool-usage knowledge to improve exploitation effectiveness; (2) extending benchmarks to include more vulnerabilities and attack types; and (3) fostering developer trust by incorporating explainable mechanisms and human review. As an emerging result with substantial potential impact, PenForge embodies the early-stage yet paradigm-shifting idea of on-the-fly agent construction, marking its promise as a step toward scalable and effective LLM-driven penetration testing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑