arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2307.02612cs.SE
收藏

数据库检索与滚雪球法成功结合用于系统文献研究中识别原始研究

Successful Combination of Database Search and Snowballing for Identification of Primary Studies in Systematic Literature Studies

Claes Wohlin, Marcos Kalinowski, Katia Romero Felizardo, Emilia Mendes

AI总结:

本文提出并评估了一种结合数据库检索与滚雪球法的混合检索策略,通过复现软件工程产学合作系统文献综述证明其能多识别30%的原始研究,并引入wild cards和borderline articles两个新概念以降低遗漏风险。

摘要:

背景:良好的检索策略对于成功的系统文献研究至关重要。历史上,数据库检索一直是常规做法,后来辅以滚雪球检索。我们的猜想是,如果将这两种检索方法结合起来(称为混合检索策略),我们可以执行更好的检索。目标:我们的主要目标是比较和评估混合检索策略。此外,我们比较了一些替代混合检索策略,以评估是否有可能找到更具成本效益的相关原始研究检索方式。方法:为了比较和评估混合检索策略,我们复现了一项关于软件工程中产学合作的系统文献综述(SLR)。该SLR使用了更传统的方法来检索相关文章,而复现研究则采用混合检索策略进行。结果:在我们的评估中,混合检索策略在识别相关原始研究方面表现更优。它多识别出30%的原始研究,并且在仅关注同行评审文章时识别出的数量更多。为了在研究文章评估中容纳个体观点并最小化遗漏原始研究的风险,我们在开展系统文献研究时引入了两个新概念:wild cards(外卡文章)和borderline articles(边界文章)。结论:混合检索策略是开展系统文献研究时强有力的候选方法。此外,如果根据滚雪球法的起始集合理选择,替代混合检索策略也可能是可行的。最后,这两个新概念被认为对于适应不同的个体判断以及最小化排除本应纳入的原始研究的风险至关重要。

英文摘要:

Background: A good search strategy is essential for a successful systematic literature study. Historically, database searches have been the norm, which has later been complemented with snowball searches. Our conjecture is that we can perform even better searches if combining the two search approaches, referred to as a hybrid search strategy. Objective: Our main objective was to compare and evaluate a hybrid search strategy. Furthermore, we compared some alternative hybrid search strategies to assess whether it was possible to identify more cost-efficient ways of searching for relevant primary studies. Method: To compare and evaluate the hybrid search strategy, we replicated an SLR on industry-academia collaboration in software engineering. The SLR used a more traditional approach to searching for relevant articles for an SLR, while the replication was conducted using a hybrid search strategy. Results: In our evaluation, the hybrid search strategy was superior in identifying relevant primary studies. It identified 30 percent more primary studies and even more when focusing only on peer-reviewed articles. To embrace individual viewpoints when assessing research articles and minimise the risk of missing primary studies, we introduced two new concepts, wild cards and borderline articles, when conducting systematic literature studies. Conclusions: The hybrid search strategy is a strong contender for being used when conducting systematic literature studies. Furthermore, alternative hybrid search strategies may be viable if selected wisely in relation to the start set for snowballing. Finally, the two new concepts were judged as essential to cater for different individual judgements and to minimise the risk of excluding primary studies that ought to be included.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑