arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.05964cs.CR
收藏

基于深度学习的分布外源代码数据识别:我们已经走了多远?

Deep Learning-Based Out-of-distribution Source Code Data Identification: How Far Have We Gone?

Van Nguyen, Xingliang Yuan, Tingmin Wu, Surya Nepal, Marthie Grobler, Carsten Rudolph

AI总结:

针对现有AI软件漏洞检测方法难识别分布外源代码数据的问题,本文提出基于信息论与聚类对比学习的深度学习OOD识别方法,在真实数据集上多项指标显著优于当前最优基线。

摘要:

软件漏洞(SVs)已成为安全关键型安全系统普遍、严重且至关重要的关切问题,这推动了基于AI的软件漏洞检测(SVD)方法取得重大进展。在实践中,尽管基于AI的方法在SVD及计算机视觉等其他领域应用中表现出良好性能,但众所周知,它们无法正确检测远离训练数据分布(即分布内,ID)的输入数据(称为分布外,OOD,数据)的真实标签。这一缺陷会引发严重问题:模型无法在自身可能出错时发出提示。为解决该问题,人们在将输入数据送入下游基于AI的模块前,会使用OOD检测器(即判断输入是ID还是OOD)。尽管OOD检测已在计算机视觉和医疗诊断应用中得到广泛研究,但针对OOD源代码数据检测的自动化AI技术尚未得到充分研究与探索。为此,本文提出一种创新的基于深度学习的方法,用于解决OOD源代码数据识别问题。该方法从信息论视角出发,采用创新的聚类对比学习有效学习并利用源代码特征,强化数据表示学习以解决该问题。在真实世界源代码数据集上开展的严格全面实验表明,与当前最优基线方法相比,本文方法的有效性和先进性优势显著。简而言之,平均而言,该方法在FPR、AUROC和AUPR指标上的性能分别比基线方法高出约15.27%、7.39%和4.93%。

英文摘要:

Software vulnerabilities (SVs) have become a common, serious, and crucial concern to safety-critical security systems. That leads to significant progress in the use of AI-based methods for software vulnerability detection (SVD). In practice, although AI-based methods have been achieving promising performances in SVD and other domain applications (e.g., computer vision), they are well-known to fail in detecting the ground-truth label of input data (referred to as out-of-distribution, OOD, data) lying far away from the training data distribution (i.e., in-distribution, ID). This drawback leads to serious issues where the models fail to indicate when they are likely mistaken. To address this problem, OOD detectors (i.e., determining whether an input is ID or OOD) have been applied before feeding the input data to the downstream AI-based modules. While OOD detection has been widely designed for computer vision and medical diagnosis applications, automated AI-based techniques for OOD source code data detection have not yet been well-studied and explored. To this end, in this paper, we propose an innovative deep learning-based approach addressing the OOD source code data identification problem. Our method is derived from an information-theoretic perspective with the use of innovative cluster-contrastive learning to effectively learn and leverage source code characteristics, enhancing data representation learning for solving the problem. The rigorous and comprehensive experiments on real-world source code datasets show the effectiveness and advancement of our approach compared to state-of-the-art baselines by a wide margin. In short, on average, our method achieves a significantly higher performance from around 15.27%, 7.39%, and 4.93% on the FPR, AUROC, and AUPR measures, respectively, in comparison with the baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑