复制研究：不仅仅是复制

中文摘要 AI 辅助

复制研究出于多种目的重新审视先前的实验发现，包括评估可靠性、探索可推广性以及评价研究方法。此类研究涉及的设计决策无法仅通过单一的复制标签来完全捕捉，这使得其设计难以描述和比较。我们提出了REPVIS2，一个经过验证的设计空间，它从八个实用维度描述复制研究与参考研究之间的关系，每个维度被编码为相同、相似或不同。我们通过将初始设计空间REPVIS1应用于一个复制研究语料库来对其进行改进，并针对另一个独立的语料库验证了REPVIS2。随后，我们通过配对阅读复制报告和参考报告，对来自51篇可视化论文中的86项复制研究进行了特征描述。研究通常保留任务，但改变程序、界面、环境、参与者群体、证据或分析。超出复制核心的添加内容也很常见。REPVIS2使复制设计在特征描述、报告和规划方面变得明确。交互式可视化和补充材料可在该https URL获取。

英文摘要

Replication studies revisit previous experimental findings for multiple purposes, including assessing reliability, exploring generalisability, and evaluating research methods. Such studies entail design decisions that a single replication label cannot fully capture, making their designs difficult to describe and compare. We present REPVIS2, a validated design space that describes how a replication study relates to a reference study across eight practical dimensions, each coded as identical, similar, or different. We refined our initial design space, REPVIS1, by applying it to a corpus of replication studies and validated REPVIS2 against a separate corpus. We then characterised 86 replication studies from 51 papers in visualisation through paired reading of the replication and reference reports. Studies often retained the task while changing the procedure, interface, environment, participant population, evidence, or analysis. Additions beyond the replication core were also common. REPVIS2 makes replication design explicit for characterisation, reporting, and planning. An interactive visualisation and supplementary materials are available at https://replication-study.github.io/.

发表机构

• Monash University（莫纳什大学）

机构由 AI 辅助整理，请以论文原文为准。