苹果、橘子与软件工程:关于潜变量二次研究的研究选择挑战
Apples, Oranges, and Software Engineering: Study Selection Challenges for Secondary Research on Latent Variables
AI总结:
本经验报告探讨了软件工程中潜变量二次研究在研究选择时面临的挑战,指出因抽象概念操作化方式多样且缺乏标准化测量工具,导致难以判断和比较不同原始研究,旨在引发关于系统性解决策略的讨论。
摘要:
软件工程(SE)充满了对研究人员和从业者至关重要的抽象概念,例如编程经验、团队生产力、代码理解能力和系统安全性。因此,旨在总结关于这些概念影响和后果的研究的二次研究将具有巨大价值。然而,无法直接测量抽象概念给二次研究带来了挑战:SE中的原始研究可以通过多种方式将这些概念操作化。标准化的测量工具很少见,即使有,许多研究人员也不使用它们,甚至不为所研究的概念提供定义。因此,进行二次研究的SE研究人员必须决定:a)哪些原始研究旨在测量相同的构念,以及b)如何比较和聚合针对同一构念的截然不同的测量结果。在这份经验报告中,我们讨论了SE中关于潜变量的二次研究在研究选择方面的挑战。我们报告了两个实例,在这两个实例中,我们发现决定哪些原始研究应被纳入比较和综合尤为困难,以免最终将苹果与橘子进行比较。我们的报告旨在引发关于开发系统性策略以解决此问题的对话,并为软件工程中更高效、更严谨的二次研究铺平道路。
英文摘要:
Software engineering (SE) is full of abstract concepts that are crucial for both researchers and practitioners, such as programming experience, team productivity, code comprehension, and system security. Secondary studies aimed at summarizing research on the influences and consequences of such concepts would therefore be of great value. However, the inability to measure abstract concepts directly poses a challenge for secondary studies: primary studies in SE can operationalize such concepts in many ways. Standardized measurement instruments are rarely available, and even if they are, many researchers do not use them or do not even provide a definition for the studied concept. SE researchers conducting secondary studies therefore have to decide a) which primary studies intended to measure the same construct, and b) how to compare and aggregate vastly different measurements for the same construct. In this experience report, we discuss the challenge of study selection in SE secondary research on latent variables. We report on two instances where we found it particularly challenging to decide which primary studies should be included for comparison and synthesis, so as not to end up comparing apples with oranges. Our report aims to spark a conversation about developing strategies to address this issue systematically and pave the way for more efficient and rigorous secondary studies in software engineering.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。