arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.12093cs.SE
收藏

通过实时的了解复制步骤增强移动应用程序错误报告

Enhancing Mobile App Bug Reporting via Real-time Understanding of Reproduction Steps

Mattia Fazzini, Kevin Moran, Carlos Bernal Cardenas, Tyler Wendland, Alessandro Orso, Denys Poshyvanyk

摘要:

开发人员从用户那里接收关于软件现场故障的反馈的主要机制之一是通过错误报告。不幸的是,手工编写的错误报告的质量可能会有很大的差异,这是因为需要包括基本信息,例如详细的复制步骤(S2R)。尽管报告者面临着困难,但很少有现有的错误报告系统试图为用户提供自动化的帮助,以制作易于阅读和方便复制的错误报告。为了解决需要积极主动的错误报告系统,积极帮助用户捕捉关键信息,我们介绍了一种新的错误报告方法,称为EBug。EBug通过实时的【形】分析报告者输入的自然语言信息,并将这些数据与通过静态和动态程序分析相结合提取的信息联系起来,帮助报告者为移动应用程序编写S2R。当记者编写S2R时,EBug能够使用根据实际应用程序使用情况训练的预测模型自动建议潜在的未来步骤。为了评估EBug,我们基于来自$11$真实世界应用程序的20个故障进行了两项用户研究。实证研究涉及10名参与者,每个人提交了10个错误报告,10名开发人员复制了提交的错误报告。在这些研究中,我们发现报告者使用EBug构建错误报告的速度比使用最先进的错误报告系统作为基线要快31倍。EBug的报告相对于基线生成的报告也更具可重复性。此外,我们将EBug的预测模型与其他预测建模方法进行了比较,发现总体而言,我们方法的预测模型优于基线方法。我们的研究结果是有希望的,并展示了潜在的好处,提供了积极的辅助错误报告系统。

英文摘要:

One of the primary mechanisms by which developers receive feedback about in-field failures of software from users is through bug reports. Unfortunately, the quality of manually written bug reports can vary widely due to the effort required to include essential pieces of information, such as detailed reproduction steps (S2Rs). Despite the difficulty faced by reporters, few existing bug reporting systems attempt to offer automated assistance to users in crafting easily readable, and conveniently reproducible bug reports. To address the need for proactive bug reporting systems that actively aid the user in capturing crucial information, we introduce a novel bug reporting approach called EBug. EBug assists reporters in writing S2Rs for mobile applications by analyzing natural language information entered by reporters in real-time, and linking this data to information extracted via a combination of static and dynamic program analyses. As reporters write S2Rs, EBug is capable of automatically suggesting potential future steps using predictive models trained on realistic app usages. To evaluate EBug, we performed two user studies based on 20 failures from $11$ real-world apps. The empirical studies involved ten participants that submitted ten bug reports each and ten developers that reproduced the submitted bug reports. In the studies, we found that reporters were able to construct bug reports 31 faster with EBug as compared to the state-of-the-art bug reporting system used as a baseline. EBug's reports were also more reproducible with respect to the ones generated with the baseline. Furthermore, we compared EBug's prediction models to other predictive modeling approaches and found that, overall, the predictive models of our approach outperformed the baseline approaches. Our results are promising and demonstrate the potential benefits provided by proactively assistive bug reporting systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑