Capture-the-Flag (CTF) competitions serve as gateways into offensive cybersecurity, yet they often present steep barriers for novices due to complex toolchains and opaque workflows. Recently, agentic AI frameworks for cybersecurity promise to lower these barriers by automating and coordinating penetration testing tasks. However, their role in shaping novice learning remains underexplored.
We present a human-centered, mixed-methods case study examining how agentic AI frameworks -- here Cybersecurity AI (CAI) -- mediates novice entry into CTF-based penetration testing. An undergraduate student without prior hacking experience attempted to approach performance benchmarks from a national cybersecurity challenge using CAI. Quantitative performance metrics were complemented by structured reflective analysis of learning progression and AI interaction patterns.
Our thematic analysis suggest that agentic AI reduces initial entry barriers by providing overview, structure and guidance, thereby lowering the cognitive workload during early engagement. Quantitatively, the observed extensive exploration of strategies and low per-strategy execution time potetially facilitatates cybersecurity training on meta, i.e. strategic levels. At the same time, AI-assisted cybersecurity education introduces new challenges related to trust, dependency, and responsible use. We discuss implications for human-centered AI-supported cybersecurity education and outline open questions for future research.
How Do LLM Agents Actually Get the Flag? Trace-Level Provenance for Agentic Offensive Security Evaluation
NYU Tandon School of Engineering(纽约大学坦登工程学院);NYU Abu Dhabi(纽约大学阿布扎比分校);CISPA - Helmholtz Center for Information Security(CISPA亥姆霍兹信息安全中心);International Institute of Information Technology Hyderabad(海得拉巴国际信息技术学院);Indian Institute of Technology Tirupati(蒂鲁帕蒂印度理工学院)
Cybersecurity AI: Evaluating Agentic Cybersecurity in Attack/Defense CTFs
Alias Robotics;Università degli Studi di Napoli Federico II(那不勒斯费德里科二世大学);Johannes Kepler University Linz(林茨约翰内斯开普勒大学);Alpen-Adria-Universität Klagenfurt(阿尔卑斯-亚得里亚-克拉根福大学)
该研究利用 CAI 框架在 23 个攻防 CTF 中实测自主 AI 智能体,发现防御优势仅在无约束补丁条件下成立,实际可用性与防入侵约束会显著拉低其表现。
Benefits and Pitfalls of Using Capture the Flag Games in University Courses
用于练习网络安全技能的Capture the Flag(CTF)游戏的概念在非正式教育环境和休闲比赛中广泛存在。然而,它在大学课程中使用得并不多。本文总结了我们的经验,从使用危险CTF游戏作为家庭作业在介绍本科课程。我们对描述学生在游戏中的行为和课程表现的数据进行了分析,揭示了CTF任务设计中应该解决的四个方面:评分,脚手架,剽窃和所用CTF平台的学习分析能力。本文通过分享我们的建议来解决这些问题。我们相信,这些建议对于考虑使用CTF游戏进行大学课程评估的网络安全教师和CTF游戏框架开发人员非常有用。
Pentest-R1: Towards Autonomous Penetration Testing Reasoning Optimized via Two-Stage Reinforcement Learning
State Key Laboratory of Cyberspace Security Defense, Institute of Information Engineering, Chinese Academy of Sciences(中国科学院网络空间安全防御重点实验室,信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络与安全学院)
Staying on the Attack Path: Structured State for Long-Horizon Automated Penetration Testing
Tianjin University(天津大学);Changchun University of Science and Technology(长春理工大学);Jilin Province Key Laboratory of Network and Information Security(吉林省网络与信息安全重点实验室);Shihezi University(石河子大学)