arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2107.01984cs.CY
收藏

计算教育研究文献的经验主义和报告规范的系统综述

A Systematic Literature Review of Empiricism and Norms of Reporting in Computing Education Research Literature

Sarah Heckman, Jeffrey C. Carver, Mark Sherriff, Ahmed Al-Zubidy

摘要:

计算教育研究(CER)对于支持越来越多需要学习计算技能的学生至关重要。为了系统地推进知识,出版物必须足够清晰,以支持复制,荟萃分析和理论构建。本研究的目的是通过确定出版物是否包含支持重复、荟萃分析和理论构建的信息,来描述CER文献中的药物滥用报告。研究问题是:RQ 1)CER场地中有多少百分比的论文具有实证评估?RQ 2)经验评估的特点是什么?RQ 3)进行实证评估的论文是否遵循报告规范(包括关键信息的纳入和标签)?我们对2014年和2015年在五个CER地点发表的427篇论文进行了SLR:SIGCSE TS,ICER,ITiCSE,TOCE和CSE。我们开发并应用了CER经验评估规则。超过80%的论文有某种形式的经验评估。定量评价方法是最常用的方法。论文最常报告的结果围绕教学技术,课程,社区或工具的干预措施。在对干预措施和其他数据集或基线进行某种比较的论文中存在分歧。许多论文缺乏适当报告的研究目的,目标,研究问题,或假设,参与者的描述,研究设计,数据汇集,有效性的威胁。CER作者为文献提供了经验性结果;然而,并非所有报告规范均得到满足。我们鼓励作者提供关于他们工作的清晰的,标记的细节,以便读者可以使用复制和荟萃分析的方法和结果。随着我们社区的发展,我们的CER报告应该成熟,以帮助建立计算教育理论,以支持下一代计算学习者。

英文摘要:

Computing Education Research (CER) is critical for supporting the increasing number of students who need to learn computing skills. To systematically advance knowledge, publications must be clear enough to support replications, meta-analyses, and theory-building. The goal of this study is to characterize the reporting of empiricism in CER literature by identifying whether publications include information to support replications, meta-analyses, and theory building. The research questions are: RQ1) What percentage of papers in CER venues have empirical evaluation? RQ2) What are the characteristics of the empirical evaluation? RQ3) Do the papers with empirical evaluation follow reporting norms (both for inclusion and for labeling of key information)? We conducted an SLR of 427 papers published during 2014 and 2015 in five CER venues: SIGCSE TS, ICER, ITiCSE, TOCE, and CSE. We developed and applied the CER Empiricism Assessment Rubric. Over 80% of papers had some form of empirical evaluation. Quantitative evaluation methods were the most frequent. Papers most frequently reported results on interventions around pedagogical techniques, curriculum, community, or tools. There was a split in papers that had some type of comparison between an intervention and some other data set or baseline. Many papers lacked properly reported research objectives, goals, research questions, or hypotheses, description of participants, study design, data collection, and threats to validity. CER authors are contributing empirical results to the literature; however, not all norms for reporting are met. We encourage authors to provide clear, labeled details about their work so readers can use the methodologies and results for replications and meta-analyses. As our community grows, our reporting of CER should mature to help establish computing education theory to support the next generation of computing learners.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑