K-Detector:识别大规模软件交付中的重复崩溃故障
K-Detector: Identifying Duplicate Crash Failures in Large-Scale Software Delivery
摘要:
在开发人员提交代码后,相应的测试用例会出现,以确保软件交付的质量。在此期间可能会发生测试失败,例如崩溃、错误和超时。由于开发人员需要时间来解决它们,因此在此期间会发生许多重复故障。在SAP HANA的交付实践中,紧急分流被认为是最耗时的任务。如果可以自动识别重复的碰撞故障,自动化程度将大大提高。为了找到这样的重复,我们提出了一个基于训练的数学模型,利用SAP HANA的组件信息,以实现更好的崩溃相似性比较。我们在一个名为基于知识的检测器(K-Detector)的工具中实现了我们的方法,该工具通过11,208个样本进行了验证,AUC为0.986。此外,我们已经将K-Detector部署到生产环境中,它可以节省97%的事故分类统计工作。
英文摘要:
After a developer submits code, corresponding test cases arise to ensure the quality of software delivery. Test failures would occur during this period, such as crash, error, and timeout. Since it takes time for developers to resolve them, many duplicate failures will happen during this period. In the delivery practice of SAP HANA, crash triage is considered as the most time-consuming task. If duplicate crash failures can be automatically identified, the degree of automation will be significantly enhanced. To find such duplicates, we propose a training-based mathematical model that utilizes component information of SAP HANA to achieve better crash similarity comparison. We implement our approach in a tool named Knowledge-based Detector (K-Detector), which is verified by 11,208 samples and performs 0.986 in AUC. Furthermore, we have deployed K-Detector to the production environment, and it can save 97% human efforts in crash triage as statistics.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。