arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1702.07082math.STstat.TH
收藏

有限情形下最优信号检测方法的分布和统计功效

Distributions and Statistical Power of Optimal Signal-Detection Methods In Finite Cases

Hong Zhang, Jiashun Jin, Zheyang Wu

摘要:

在用于检测$n$特征中的稀有和弱信号的大数据分析中,当$n \rightarrow \infty$时,一些分组测试方法,例如高级批评测试(HC)、Berk-Jones测试(B-J)和$ϕ$ -发散测试共享类似的渐近最优性。然而,在实际数据分析中,$n$通常较小,最多为中等大小。为了正确应用这些最优检验并明智地选择它们用于实际研究,重要的是要知道如何获得它们的p值和统计功效。为了在更广泛的背景下解决这个问题,本文提供了一个一般家庭的拟合优度(GOF)测试,其中包括这些最佳的测试分析解决方案。对于任何给定的身份证。和$n$特征的输入检验统计量的连续分布,可以计算这种GOF检验的p值和统计功效。通过计算比较了正态混合方案下渐近最优检验的有限样本性能。结果表明,HC是最好的选择时,信号是罕见的,而B-J是更强大的各种信号模式。在一个真正的全基因组关联研究中的应用,结果表明,p值计算效果良好,最佳测试有潜力检测新的疾病基因与弱遗传效应。计算已在R包SetTest中实现,并在CRAN上发布。

英文摘要:

In big data analysis for detecting rare and weak signals among $n$ features, some grouping-test methods such as Higher Criticism test (HC), Berk-Jones test (B-J), and $ϕ$-divergence test share the similar asymptotical optimality when $n \rightarrow \infty$. However, in practical data analysis $n$ is frequently small and moderately large at most. In order to properly apply these optimal tests and wisely choose them for practical studies, it is important to know how to get the p-values and statistical power of them. To address this problem in an even broader context, this paper provides analytical solutions for a general family of goodness-of-fit (GOF) tests, which covers these optimal tests. For any given i.i.d. and continuous distributions of the input test statistics of the $n$ features, both p-value and statistical power of such a GOF test can be calculated. By calculation we compared the finite-sample performances of asymptotically optimal tests under the normal mixture alternative. Results show that HC is the best choice when signals are rare, while B-J is more robust over various signal patterns. In the application to a real genome-wide association study, results illustrate that the p-value calculation works well, and the optimal tests have potentials for detecting novel disease genes with weak genetic effects. The calculations have been implemented in an R package SetTest and published on the CRAN.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑