arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2101.12591cs.SE
收藏

将贝叶斯分析指南应用于实证软件工程数据:编程语言与代码质量案例

Applying Bayesian Analysis Guidelines to Empirical Software Engineering Data: The Case of Programming Languages and Code Quality

Carlo A. Furia, Richard Torkar, Robert Feldt

AI总结:

本文面向实证软件工程改编贝叶斯数据分析指南,并通过重新分析编程语言与代码质量的 GitHub 数据集,展示构建严谨灵活分析流程的方法及价值。

摘要:

统计分析是将数据转化为信息、再将信息转化为实证知识的首选工具。为保证有效性,从数据到知识的过程应由详尽、严谨的指南支撑,这些指南有助于发现数据或模型中的问题,并得出在一般性与实践相关性之间取得合理平衡的合格结果。统计学家正在制定此类指南,以支持最新的贝叶斯数据分析技术。本文以适合软件工程实证研究的方式构建这些指南。为在实践中演示这些指南,我们将其应用于重新分析一个关于不同编程语言代码质量的 GitHub 数据集。该数据集的原始分析(Ray 等,2014)以及一项批判性再分析(Berger 等,2019)已引起广泛关注——这在很大程度上是因为它们聚焦于一个众说纷纭的主题,即不同编程语言的影响。我们再分析的目标在很大程度上与既有工作正交,因为我们关注的是在一个有趣领域的数据上演示如何构建有原则的贝叶斯数据分析,并展示其部分优势。在此过程中,我们还将阐明所分析数据的若干关键方面,以及编程语言与代码质量之间的关系。本实践的总体结论是:贝叶斯统计技术能够以有原则、灵活的方式用于分析软件工程数据,并产生有说服力的结果;这些结果既为当前技术水平提供信息,也凸显其有效性边界。这些指南可支持构建可靠的统计分析并串联其结果,从而有助于巩固实证软件工程研究的持续进展。

英文摘要:

Statistical analysis is the tool of choice to turn data into information, and then information into empirical knowledge. To be valid, the process that goes from data to knowledge should be supported by detailed, rigorous guidelines, which help ferret out issues with the data or model, and lead to qualified results that strike a reasonable balance between generality and practical relevance. Such guidelines are being developed by statisticians to support the latest techniques for Bayesian data analysis. In this article, we frame these guidelines in a way that is apt to empirical research in software engineering. To demonstrate the guidelines in practice, we apply them to reanalyze a GitHub dataset about code quality in different programming languages. The dataset's original analysis (Ray et al., 2014) and a critical reanalysis (Berger at al., 2019) have attracted considerable attention -- in no small part because they target a topic (the impact of different programming languages) on which strong opinions abound. The goals of our reanalysis are largely orthogonal to this previous work, as we are concerned with demonstrating, on data in an interesting domain, how to build a principled Bayesian data analysis and to showcase some of its benefits. In the process, we will also shed light on some critical aspects of the analyzed data and of the relationship between programming languages and code quality. The high-level conclusions of our exercise will be that Bayesian statistical techniques can be applied to analyze software engineering data in a way that is principled, flexible, and leads to convincing results that inform the state of the art while highlighting the boundaries of its validity. The guidelines can support building solid statistical analyses and connecting their results, and hence help buttress continued progress in empirical software engineering research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑