arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1903.08747stat.MEstat.AP
收藏

可复制性评估的统计方法

Statistical Methods for Replicability Assessment

Kenneth Hung, William Fithian

摘要:

大规模的复制研究,如生殖科学项目:心理学(RP:P)提供了关于科学可复制性的宝贵的系统数据,但大多数对数据的分析和解释未能就“可复制性”的定义达成一致,也未能将已知的选择偏差的必然后果与竞争性解释分开。我们讨论了可复制性的三个具体定义,基于(1)已发表的关于效应符号的发现是否大多正确,(2)复制研究在复制原始实验中存在的任何真实效应量方面的有效性,以及(3)真实效应量是否倾向于在复制中减少。我们应用技术从多重检验和后选择推理开发新的方法,回答这些问题,同时明确占选择偏差。我们的分析表明,RP:P数据集在很大程度上与由于选择显著效应而导致的发表偏倚一致。本文中的方法对真实效应量没有分布假设。

英文摘要:

Large-scale replication studies like the Reproducibility Project: Psychology (RP:P) provide invaluable systematic data on scientific replicability, but most analyses and interpretations of the data fail to agree on the definition of "replicability" and disentangle the inexorable consequences of known selection bias from competing explanations. We discuss three concrete definitions of replicability based on (1) whether published findings about the signs of effects are mostly correct, (2) how effective replication studies are in reproducing whatever true effect size was present in the original experiment, and (3) whether true effect sizes tend to diminish in replication. We apply techniques from multiple testing and post-selection inference to develop new methods that answer these questions while explicitly accounting for selection bias. Our analyses suggest that the RP:P dataset is largely consistent with publication bias due to selection of significant effects. The methods in this paper make no distributional assumptions about the true effect sizes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑