不要在沼泽地上建造城堡！循证软件工程中再现自动搜索的危机
Stop Building Castles on a Swamp! The Crisis of Reproducing Automatic Search in Evidence-based Software Engineering
摘要：
基于证据的方法越来越多地被用来综合软件工程中主要研究的经验发现。然而，基于证据的软件工程（EBSE）研究的可重复性似乎没有得到充分重视。在我们对311个样本研究的自动搜索的调查中，超过50%的搜索字符串是不可重用的;大约87.5%的搜索活动（例如，搜索字段设置）是不可重复的;并且超过95%的整个自动搜索实现是不可重复的。考虑到搜索是EBSE研究的基石，我们担心当前二级研究的可重复性可能比我们想象的更差。通过分析和报告上述观察结果的根本原因，我们敦促我们社区所有利益相关者之间的协作与合作，以提高EBSE的研究重现性。
英文摘要：
The evidence-based approach has increasingly been employed to synthesize empirical findings from the primary research in software engineering. Nevertheless, the reproducibility of evidence-based software engineering (EBSE) studies seems to be underemphasized. In our investigation into the automatic search of 311 sample studies, more than 50% of the search strings are not reusable; about 87.5% of the search activities (e.g., search field settings) are unrepeatable; and more than 95% of the whole automatic search implementations are unreproducible. Considering that searching is a cornerstone of an EBSE study, we are afraid that the reproducibility of the current secondary research could be worse than we can imagine. By analyzing and reporting the root causes of the aforementioned observations, we urge collaboration and cooperation among all the stakeholders in our community to improve the research reproducibility in EBSE.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
