第二代p值:提高统计分析的严谨性、可重复性和透明度
Second-generation p-values: improved rigor, reproducibility, & transparency in statistical analyses
摘要:
证明一个统计学上显著的结果是有科学意义的,不仅是一个好的科学实践,而且是控制第一类错误率的自然方法。在这里,我们介绍了一种新的p值扩展-第二代p值-正式解释了科学相关性,并利用了这种自然的第一类错误控制。该方法依赖于一个预先指定的区间原假设,该假设代表了科学上不感兴趣或实际上为零的效应量的集合。第二代p值是数据支持的假设也是零假设的比例。因此,第二代p值表示数据何时与零假设或备择假设相容,或数据何时不确定。此外,第二代p值为多重比较提供了适当的科学调整,并降低了错误发现率。这对于数据丰富的环境来说是一个进步,传统的p值调整是不必要的惩罚。第二代p值通过先验指定哪些候选假设实际上有意义,并通过提供更可靠的统计摘要来说明数据何时与替代假设或零假设兼容,从而提高了科学结果的透明度,严谨性和可重复性。
英文摘要:
Verifying that a statistically significant result is scientifically meaningful is not only good scientific practice, it is a natural way to control the Type I error rate. Here we introduce a novel extension of the p-value - a second-generation p-value - that formally accounts for scientific relevance and leverages this natural Type I Error control. The approach relies on a pre-specified interval null hypothesis that represents the collection of effect sizes that are scientifically uninteresting or are practically null. The second-generation p-value is the proportion of data-supported hypotheses that are also null hypotheses. As such, second-generation p-values indicate when the data are compatible with null hypotheses, or with alternative hypotheses, or when the data are inconclusive. Moreover, second-generation p-values provide a proper scientific adjustment for multiple comparisons and reduce false discovery rates. This is an advance for environments rich in data, where traditional p-value adjustments are needlessly punitive. Second-generation p-values promote transparency, rigor and reproducibility of scientific results by a priori specifying which candidate hypotheses are practically meaningful and by providing a more reliable statistical summary of when the data are compatible with alternative or null hypotheses.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。