REST:一种安全论坛用户信息识别与分类的线程嵌入方法
REST: A Thread Embedding Approach for Identifying and Classifying User-specified Information in Security Forums
摘要:
我们如何从安全论坛中提取有用的信息?我们专注于识别安全专业人员感兴趣的线程:(a)令人担忧的事件(如攻击)的警报,(b)提供恶意服务和产品,(c)执行恶意行为的黑客信息,以及(d)有用的安全相关体验。安全论坛的分析处于起步阶段,尽管最近有几个有前途的作品。需要采取新的办法来应对这一领域的挑战:(a)难以有效地确定感兴趣的“专题”;(b)案文的无结构和非正式性质。我们提出,REST,一个系统的方法来:(a)识别线程的基础上,可能不完整,袋的话,和(b)将它们分类到上述四个类之一。这项工作的关键新颖性是一个多步骤的加权嵌入方法:我们在适当的嵌入空间中投影单词,线程和类,并在那里建立相关性和相似性。我们使用来自三个安全论坛的真实数据来评估我们的方法,这些论坛共有164 K帖子和21 K线程。首先,REST对初始关键字选择的鲁棒性可以扩展用户提供的关键字集,因此可以从丢失的关键字中恢复。其次,REST将线程分类到感兴趣的类别中,与其他五种方法相比具有更高的准确性:REST的准确率在63.3- 76.9%之间。我们认为我们的方法是以用户友好的方式利用在线论坛信息财富的第一步,因为用户可以松散地指定她感兴趣的关键字。
英文摘要:
How can we extract useful information from a security forum? We focus on identifying threads of interest to a security professional: (a) alerts of worrisome events, such as attacks, (b) offering of malicious services and products, (c) hacking information to perform malicious acts, and (d) useful security-related experiences. The analysis of security forums is in its infancy despite several promising recent works. Novel approaches are needed to address the challenges in this domain: (a) the difficulty in specifying the "topics" of interest efficiently, and (b) the unstructured and informal nature of the text. We propose, REST, a systematic methodology to: (a) identify threads of interest based on a, possibly incomplete, bag of words, and (b) classify them into one of the four classes above. The key novelty of the work is a multi-step weighted embedding approach: we project words, threads and classes in appropriate embedding spaces and establish relevance and similarity there. We evaluate our method with real data from three security forums with a total of 164k posts and 21K threads. First, REST robustness to initial keyword selection can extend the user-provided keyword set and thus, it can recover from missing keywords. Second, REST categorizes the threads into the classes of interest with superior accuracy compared to five other methods: REST exhibits an accuracy between 63.3-76.9%. We see our approach as a first step for harnessing the wealth of information of online forums in a user-friendly way, since the user can loosely specify her keywords of interest.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。