arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.17068cs.CR
收藏

安全文本中自动对抗技术标注的语义排序

Semantic Ranking for Automated Adversarial Technique Annotation in Security Text

Udesh Kumarasinghe, Ahmed Lekssays, Husrev Taha Sencar, Sabri Boughorbel, Charitha Elvitigala, Preslav Nakov

AI总结:

提出基于多阶段排序架构的方法,从威胁情报文本中提取结构化威胁行为,在零样本设置下性能优于大型语言模型,top-3召回率达81%。

摘要:

我们介绍了一种从威胁情报文本中提取结构化威胁行为的新方法。该方法基于多阶段排序架构,允许联合优化效率与有效性。考虑到大量对抗技术及安全分析师创建的广泛威胁情报,我们认为此问题表述更符合任务的真实性质。研究结果表明,所提出的系统在该任务上取得了最先进的性能。结果显示,我们的方法在193个顶级技术中识别相关技术的top-3召回率为81%。测试还表明,在零样本设置下,我们的系统比广泛使用的大型语言模型表现显著更好(+40%)。

英文摘要:

We introduce a new method for extracting structured threat behaviors from threat intelligence text. Our method is based on a multi-stage ranking architecture that allows jointly optimizing for efficiency and effectiveness. Therefore, we believe this problem formulation better aligns with the real-world nature of the task considering the large number of adversary techniques and the extensive body of threat intelligence created by security analysts. Our findings show that the proposed system yields state-of-the-art performance results for this task. Results show that our method has a top-3 recall performance of 81\% in identifying the relevant technique among 193 top-level techniques. Our tests also demonstrate that our system performs significantly better (+40\%) than the widely used large language models when tested under a zero-shot setting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑