arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.18908stat.MEmath.STstat.TH
收藏

使用 $p$ 值的序贯蒙特卡洛计算进行推断:快速且有效的方法

Inference with Sequential Monte-Carlo Computation of $p$-values: Fast and Valid Approaches

Ivo V. Stoepker, Rui M. Castro

AI总结:

本文综述了蒙特卡洛假设检验中的有效性概念,并提出了一种序贯更新 $p$ 值估计的新方法,在保证有效性的同时提升了计算效率。

摘要:

通过(重)采样方法(如置换检验、秩检验和自助法检验)校准的假设检验是统计分析的有用工具,其计算代价是需要进行蒙特卡洛采样以完成校准。常见的且几乎是普遍的做法是,使用预先设定的、大量的蒙特卡洛样本执行此类检验,并在得出和报告推断时忽略此采样带来的任何随机性。这种方法最好也只是导致计算效率低下,最坏则会导致无效推断。尽管如此,文献中已提出许多方法来自适应地指导分析者选择蒙特卡洛样本数量,通过序贯决定何时停止收集样本并得出推断。这些工作引入了不同的、相互竞争的关于什么构成“有效”推断的概念,使得寻求合适方法的分析者面临复杂的局面。此外,这些方法大多数仅保证对检验结果的有意义的估计,而不是 $p$ 值本身——这对许多实际应用来说是不够的。在本文中,我们调查了相关文献,并在分散的有效性概念之间建立联系,突出了它们的一些互补作用。我们还引入了一种新的实用方法,该方法提供了蒙特卡洛检验 $p$ 值的估计,并具有实际相关的有效性保证。此外,我们的方法是序贯的,在每抽取一个新的蒙特卡洛样本后更新 $p$ 值估计,同时无论选择何种停止时间都保持重要的有效性保证。我们以一组针对实践者的建议作为本文的结尾,包括方法选择和结果报告方式。

英文摘要:

Hypothesis tests calibrated by (re)sampling methods (such as permutation, rank and bootstrap tests) are useful tools for statistical analysis, at the computational cost of requiring Monte-Carlo sampling for calibration. It is common and almost universal practice to execute such tests with predetermined and large number of Monte-Carlo samples, and disregard any randomness from this sampling at the time of drawing and reporting inference. At best, this approach leads to computational inefficiency, and at worst to invalid inference. That being said, a number of approaches in the literature have been proposed to adaptively guide analysts in choosing the number of Monte-Carlo samples, by sequentially deciding when to stop collecting samples and draw inference. These works introduce varying competing notions of what constitutes "valid" inference, complicating the landscape for analysts seeking suitable methodology. Furthermore, the majority of these approaches solely guarantee a meaningful estimate of the testing outcome, not the $p$-value itself $\unicode{x2014}$ which is insufficient for many practical applications. In this paper, we survey the relevant literature, and build bridges between the scattered validity notions, highlighting some of their complementary roles. We also introduce a new practical methodology that provides an estimate of the $p$-value of the Monte-Carlo test, endowed with practically relevant validity guarantees. Moreover, our methodology is sequential, updating the $p$-value estimate after each new Monte-Carlo sample has been drawn, while retaining important validity guarantees regardless of the selected stopping time. We conclude this paper with a set of recommendations for the practitioner, both in terms of selection of methodology and manner of reporting results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑