arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 0903.0464math.STstat.TH
收藏

多个测试程序对相关性的鲁棒性

Robustness of multiple testing procedures against dependence

Sandy Clarke, Peter Hall

摘要:

多重假设检验的一个重要方面是控制显着性水平或I型错误的水平。当检验统计量不独立时,在不采取非常保守的程序的情况下处理这个问题可能特别具有挑战性。在本文中,我们表明,在当代的多重测试问题的背景下,测试的数量往往是非常大的,所造成的困难的依赖是不那么严重,比在经典的情况下。当检验统计量的零分布是相对轻尾的时,例如,当它们可以基于正态或学生$t$近似时,尤其如此。在那里,如果检验统计量可以被公平地看作是由线性过程产生的,那么当假设的数量发散时,基于不正确的独立性假设的分析是渐近正确的。特别地,表示统计上显著的检验结果出现的指数的零分布的点过程近似为泊松,就像独立的情况一样。泊松过程也具有与独立情况相同的均值,当然也没有出现错误发现的聚集。然而,如果零分布是特别重尾的,则该结果可能失败。即使原假设是正确的,也可能出现统计学显著性结果的集群。我们给出了一个直观的解释,这些不同的性质在轻尾和重尾的情况下,并提供了严格的理论支撑的直觉。

英文摘要:

An important aspect of multiple hypothesis testing is controlling the significance level, or the level of Type I error. When the test statistics are not independent it can be particularly challenging to deal with this problem, without resorting to very conservative procedures. In this paper we show that, in the context of contemporary multiple testing problems, where the number of tests is often very large, the difficulties caused by dependence are less serious than in classical cases. This is particularly true when the null distributions of test statistics are relatively light-tailed, for example, when they can be based on Normal or Student's $t$ approximations. There, if the test statistics can fairly be viewed as being generated by a linear process, an analysis founded on the incorrect assumption of independence is asymptotically correct as the number of hypotheses diverges. In particular, the point process representing the null distribution of the indices at which statistically significant test results occur is approximately Poisson, just as in the case of independence. The Poisson process also has the same mean as in the independence case, and of course exhibits no clustering of false discoveries. However, this result can fail if the null distributions are particularly heavy-tailed. There clusters of statistically significant results can occur, even when the null hypothesis is correct. We give an intuitive explanation for these disparate properties in light- and heavy-tailed cases, and provide rigorous theory underpinning the intuition.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑