重新审视计算教育研究中用于复制研究的设计
Revisiting the Replication Study Design Used in Computing Education Research
AI总结:
本研究评估了自2019年以来计算教育研究领域复制研究的演变,发现复制研究比例略有增加,但整体增长有限,研究者在发表复制研究时面临显著挑战。
摘要:
复制研究在计算教育研究(CER)中起着重要作用,通过支持一致且可靠的科学知识发展。然而,先前研究指出,CER社区更重视新颖贡献而非复制。2019年的一次系统综述(SLR)发现,在2009至2018年间发表的2269篇论文中,仅有54篇复制研究。本研究旨在考察自2019年以来CER领域复制研究的格局变化。具体而言,我们调查复制研究的普及程度是否增加,并探索CER研究者对复制的当前看法和经验。我们复制了两项先前研究。首先,我们进行了更新的SLR,以识别2019至2025年间在相同五个CER会议中发表的复制研究。其次,我们复制了计算教育研究者关于进行和发表复制研究的调查。我们的SLR在2516篇发表的论文中识别出63篇复制研究。尽管复制研究的比例略有增加,但整体增长仍有限。我们观察到期刊中发表的复制研究有所增加,且作者复制自己先前工作的增加。调查结果显示,尽管许多研究者在教学和研究实践中进行复制,但在尝试发表复制研究时面临显著挑战。尽管对开放科学和研究严谨性的讨论增加,但CER领域复制研究的采用并未显著增长。我们的发现为未来研究提供了机会,以促进复制研究,并探索CER社区如何鼓励研究人员发表复制研究。
英文摘要:
Replication studies play an important role in Computing Education Research (CER) by supporting the development of consistent and reliable scientific knowledge. However, prior research indicates that the CER community tends to prioritise novel contributions over replication. A 2019 SLR identified only 54 replication studies among 2,269 papers published between 2009 and 2018 across five major CER venues. This study aims to examine how the landscape of replication research in CER has evolved since 2019. Specifically, we investigate whether the prevalence of replication studies has increased and explore current perceptions and experiences of CER researchers regarding replication. We replicated two prior studies. First, we conducted an updated SLR to identify replication studies published between 2019 and 2025 in the same five CER venues. Second, we replicated a survey of Computing Education researchers to better understand their perceptions, experiences, and challenges related to conducting and publishing replication studies. Our SLR identified 63 replication studies among 2,516 published papers. While the proportion of replication studies has increased slightly, overall growth remains limited. We observed a shift toward more published replication studies in journals and an increase in authors replicating their own prior work. Survey results indicate that although many researchers engage in replication within their teaching and research practice, they encounter significant challenges when attempting to publish replication studies. Despite increased discourse around open science and research rigour, the adoption of replication studies in CER has not substantially grown. Our findings offer opportunities for future research to promote replication and to explore how the CER community can encourage researchers to publish replication studies.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。