arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.11276cs.CR
收藏

Hackphyr:面向网络安全环境的本地微调大语言模型智能体

Hackphyr: A Local Fine-Tuned LLM Agent for Network Security Environments

Maria Rigaki, Carlos Catania, Sebastian Garcia

AI总结:

针对云端大模型在网络安全场景的隐私、成本等问题,本文提出本地微调的红队智能体Hackphyr,构建专属数据集训练7B参数模型,单GPU可运行,性能媲美GPT-4且优于多种基线,还分析了智能体的规划能力与缺陷。

摘要:

大语言模型(LLM)已在包括网络安全在内的多个领域展现出显著潜力。出于隐私顾虑、成本以及网络连接限制,使用商业化的云端大语言模型可能并非理想选择。本文提出Hackphyr——一款经本地微调、可在网络安全环境中充当红队智能体的大语言模型。我们微调后的70亿参数模型可在单张GPU卡上运行,性能可与GPT-4等规模更大、能力更强的商业模型相媲美。在复杂的未知场景中,Hackphyr的表现明显优于GPT-3.5-turbo等其他模型以及Q-learning智能体等基线方法。为实现这一性能,我们生成了一个全新的特定任务网络安全数据集,以增强基础模型的能力。最后,我们对智能体的行为开展了全面分析,揭示了此类智能体的规划能力与潜在缺陷,为更广泛地理解网络安全场景下基于大语言模型的智能体提供了参考。

英文摘要:

Large Language Models (LLMs) have shown remarkable potential across various domains, including cybersecurity. Using commercial cloud-based LLMs may be undesirable due to privacy concerns, costs, and network connectivity constraints. In this paper, we present Hackphyr, a locally fine-tuned LLM to be used as a red-team agent within network security environments. Our fine-tuned 7 billion parameter model can run on a single GPU card and achieves performance comparable with much larger and more powerful commercial models such as GPT-4. Hackphyr clearly outperforms other models, including GPT-3.5-turbo, and baselines, such as Q-learning agents in complex, previously unseen scenarios. To achieve this performance, we generated a new task-specific cybersecurity dataset to enhance the base model's capabilities. Finally, we conducted a comprehensive analysis of the agents' behaviors that provides insights into the planning abilities and potential shortcomings of such agents, contributing to the broader understanding of LLM-based agents in cybersecurity contexts

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑