arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.07808cs.SE
收藏

在静态分析中支持错误链以实现精准评估结果与增强可用性

Supporting Error Chains in Static Analysis for Precise Evaluation Results and Enhanced Usability

Anna-Katharina Wickert, Michael Schlichtig, Marvin Vogel, Lukas Winter, Mira Mezini, Eric Bodden

AI总结:

针对静态分析仅报告漏洞表现位置、易致误报和结果不精准的问题,研究适配现有算法实现错误链检测,经实验验证该方案开销低、能提升分析可用性与评估精准度。

摘要:

研究背景与问题:静态分析是成熟的技术,可在开发过程或大规模研究中辅助理解bug或漏洞。低误报率对其在实践中的落地以及实证研究结果的精准性至关重要。遗憾的是,静态分析往往报告漏洞的表现位置,而非修复位置,这可能导致误判的误报或不精准的结果。\n提出的方法与技术细节:为解决该问题,我们对现有静态分析算法进行了适配改造,该算法可区分表现位置与修复位置,并报告错误链。错误链代表至少两个连续发生的相互关联的错误,由此构建起修复位置与表现位置之间的关联。我们使用自研工具CogniCryptSUBS开展了针对471个GitHub仓库的案例研究、用于对比不同分析配置的性能基准测试,还进行了专家访谈。\n实验设置与结果:我们发现,在生成报告的项目中,有50%的项目至少存在一条错误链。我们的运行时基准测试表明,本次改进带来的运行时开销极小,不足4%。专家访谈结果显示,使用我们的适配版本后,参与者需要执行的分析次数更少。\n结论与意义:我们的结果表明,错误链在真实项目中频繁出现,忽略它们会导致评估结果不精准。运行时基准测试证明,我们的工具是检测真实项目中错误链的可行且高效的方案。此外,我们的结果还暗示,支持错误链可能会提升静态分析的可用性。

英文摘要:

Context: Static analyses are well-established to aid in understanding bugs or vulnerabilities during the development process or in large-scale studies. A low false-positive rate is essential for the adaption in practice and for precise results of empirical studies. Unfortunately, static analyses tend to report where a vulnerability manifests rather than the fix location. This can cause presumed false positives or imprecise results. Method: To address this problem, we designed an adaption of an existing static analysis algorithm that can distinguish between a manifestation and fix location, and reports error chains. An error chain represents at least two interconnected errors that occur successively, thus building the connection between the fix and manifestation location. We used our tool CogniCryptSUBS for a case study on 471 GitHub repositories, a performance benchmark to compare different analysis configurations, and conducted an expert interview. Result: We found that 50 % of the projects with a report had at least one error chain. Our runtime benchmark demonstrated that our improvement caused only a minimal runtime overhead of less than 4 %. The results of our expert interview indicate that with our adapted version participants require fewer executions of the analysis. Conclusion: Our results indicate that error chains occur frequently in real-world projects, and ignoring them can lead to imprecise evaluation results. The runtime benchmark indicates that our tool is a feasible and efficient solution for detecting error chains in real-world projects. Further, our results gave a hint that the usability of static analyses may benefit from supporting error chains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑