arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.06272cs.CR
收藏

一种基于RAG的面向网络攻击调查与归因的问答解决方案

A RAG-Based Question-Answering Solution for Cyber-Attack Investigation and Attribution

Sampath Rajapaksha, Ruby Rani, Erisa Karafili

AI总结:

本文提出首个基于RAG和LLM的网络安全问答模型,用于网络攻击调查与归因,通过提供答案来源克服GPT幻觉问题,并在多种问题类型上优于GPT-3.5和GPT-4o。

摘要:

在不断发展的网络安全领域,分析人员必须及时了解最新的攻击趋势以及有助于网络攻击调查与归因的相关信息。在这项工作中,我们提出了首个问答(QA)模型及其应用,为网络安全专家提供有关网络攻击调查与归因的信息。我们的问答模型基于检索增强生成(Retrieval Augmented Generation, RAG)技术与大语言模型(Large Language Model, LLM),并根据我们包含网络攻击调查与归因精选信息的知识库(KB)或用户提供的外部资源来回答用户查询。我们使用多种类型的问题对所提出的问答模型进行了测试和评估,包括基于知识库的问题、基于元数据的问题、针对知识库中特定文档的问题以及基于外部来源的问题。我们将基于知识库问题的答案与OpenAI的GPT-3.5和最新的GPT-4o大语言模型的答案进行了比较。我们提出的问答模型优于OpenAI的GPT模型,因为它提供了答案来源,并克服了GPT模型的幻觉局限性,这对网络攻击调查与归因至关重要。此外,我们的分析表明,当RAG问答模型被给予少样本示例而不是零样本指令时,与查询之外不提供任何示例的情况相比,它能生成更好的答案。

英文摘要:

In the constantly evolving field of cybersecurity, it is imperative for analysts to stay abreast of the latest attack trends and pertinent information that aids in the investigation and attribution of cyber-attacks. In this work, we introduce the first question-answering (QA) model and its application that provides information to the cybersecurity experts about cyber-attacks investigations and attribution. Our QA model is based on Retrieval Augmented Generation (RAG) techniques together with a Large Language Model (LLM) and provides answers to the users' queries based on either our knowledge base (KB) that contains curated information about cyber-attacks investigations and attribution or on outside resources provided by the users. We have tested and evaluated our QA model with various types of questions, including KB-based, metadata-based, specific documents from the KB, and external sources-based questions. We compared the answers for KB-based questions with those from OpenAI's GPT-3.5 and the latest GPT-4o LLMs. Our proposed QA model outperforms OpenAI's GPT models by providing the source of the answers and overcoming the hallucination limitations of the GPT models, which is critical for cyber-attack investigation and attribution. Additionally, our analysis showed that when the RAG QA model is given few-shot examples rather than zero-shot instructions, it generates better answers compared to cases where no examples are supplied in addition to the query.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑