可视化研究论文可重复性印章的状态
The State of Reproducibility Stamps for Visualization Research Papers
AI总结:
本文分析了可视化研究论文的可重复性现状,探讨了影响可重复性的因素,并提出了提高可重复性的方法。
摘要:
我分析了被图形可重复性印章计划(GRSI)认证为可重复的论文的发展历程,特别关注那些涉及可视化主题的子集。通过这项分析,我表明,尽管整体论文数量在增加,尤其是在可视化领域,我们仍需大幅改进,以摆脱复制危机。我的分析基于GRSI发布的数据以及不同可视化会议和期刊的出版数据,以及在可视化会议上发表的期刊论文列表。我还分析了所涉及期刊之间的差异,以及不同展示场合中可重复论文的百分比。此外,我研究了论文的作者及其所属国家,特别是大多数可重复论文的来源。最后,我讨论了低可重复性数字的潜在原因,并提出了可能克服这些障碍的方法。本文本身也是可重复的,源代码和数据可在github.com/tobiasisenberg/Visualization-Reproducibility上获得,免费论文副本和所有补充材料可在osf.io/mvnbj上找到。
英文摘要:
I analyze the evolution of papers certified by the Graphics Replicability Stamp Initiative (GRSI) to be reproducible, with a specific focus on the subset of publications that address visualization-related topics. With this analysis I show that, while the number of papers is increasing overall and within the visualization field, we still have to improve quite a bit to escape the replication crisis. I base my analysis on the data published by the GRSI as well as publication data for the different venues in visualization and lists of journal papers that have been presented at visualization-focused conferences. I also analyze the differences between the involved journals as well as the percentage of reproducible papers in the different presentation venues. Furthermore, I look at the authors of the publications and, in particular, their affiliation countries to see where most reproducible papers come from. Finally, I discuss potential reasons for the low reproducibility numbers and suggest possible ways to overcome these obstacles. This paper is reproducible itself, with source code and data available from github.com/tobiasisenberg/Visualization-Reproducibility as well as a free paper copy and all supplemental materials at osf.io/mvnbj.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。