arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1602.05643cs.SE
收藏

生成与重构曲面片生成系统的搜索空间分析

An Analysis of the Search Spaces for Generate and Validate Patch Generation Systems

Fan Long, Martin Rinard

摘要:

我们提出了第一个系统的分析补丁搜索空间的自动补丁生成系统的特点。我们分析了搜索空间的两个当前国家的最先进的系统,SPR和先知,16个不同的搜索空间配置。我们的结果来自1104个不同的搜索空间和768补丁生成执行的分析。这些实验在Amazon EC2上总共消耗了超过9000小时的CPU时间。分析表明:1)正确的补丁在搜索空间中是稀疏的(通常每个缺陷每个搜索空间最多一个正确的补丁),2)通过验证测试套件中所有测试用例的不正确补丁通常数量级更丰富,以及3)因此利用测试套件以外的信息对于使系统能够成功隔离正确补丁至关重要。我们还描述了一个关键的权衡结构的搜索空间。包含更多缺陷的正确补丁的更大和更丰富的搜索空间实际上会导致系统找到更少而不是更多的正确补丁。我们确定了这种现象的两个原因:1)由于存在更多候选补丁而增加了验证时间,2)通过测试套件并阻止发现正确补丁的更多不正确补丁。这些基本属性都是本文首次描述的,它们有助于解释为什么过去的系统通常无法生成正确的补丁,并有助于确定该领域的挑战、机遇和富有成效的未来方向。

英文摘要:

We present the first systematic analysis of the characteristics of patch search spaces for automatic patch generation systems. We analyze the search spaces of two current state-of-the-art systems, SPR and Prophet, with 16 different search space configurations. Our results are derived from an analysis of 1104 different search spaces and 768 patch generation executions. Together these experiments consumed over 9000 hours of CPU time on Amazon EC2. The analysis shows that 1) correct patches are sparse in the search spaces (typically at most one correct patch per search space per defect), 2) incorrect patches that nevertheless pass all of the test cases in the validation test suite are typically orders of magnitude more abundant, and 3) leveraging information other than the test suite is therefore critical for enabling the system to successfully isolate correct patches. We also characterize a key tradeoff in the structure of the search spaces. Larger and richer search spaces that contain correct patches for more defects can actually cause systems to find fewer, not more, correct patches. We identify two reasons for this phenomenon: 1) increased validation times because of the presence of more candidate patches and 2) more incorrect patches that pass the test suite and block the discovery of correct patches. These fundamental properties, which are all characterized for the first time in this paper, help explain why past systems often fail to generate correct patches and help identify challenges, opportunities, and productive future directions for the field.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑