关于Hoeffding检验及其他散度检验的二阶渐近性
On the Second-Order Asymptotics of the Hoeffding Test and Other Divergence Tests
AI总结:
该研究刻画了仅原假设已知时Hoeffding检验及一般散度检验的第二类错误概率的一、二阶渐近项,明确其与最优Neyman-Pearson检验的性能差异,并指出非不变散度检验的性能优势及在复合假设检验中的应用潜力。
摘要:
考虑二元统计假设检验问题:给定n个独立同分布的随机变量Zⁿ,其分布要么服从原假设P,要么服从备择假设Q,且仅P是已知的。适用于该场景的一种著名检验是所谓的Hoeffding检验:若Zⁿ的经验分布与P之间的Kullback-Leibler(KL,库尔贝克-莱布勒)散度低于某一阈值,则接受原假设P。本文刻画了在固定第一类错误概率的条件下,Hoeffding检验以及散度检验(将KL散度替换为一般散度的检验)的第二类错误概率的一阶项与二阶项。研究表明,无论采用何种散度,散度检验都能达到Neyman-Pearson(奈曼-皮尔逊)检验的一阶项——后者是P和Q均已知时的最优检验。相比之下,散度检验的二阶项严格差于Neyman-Pearson检验的二阶项。进一步研究发现,采用不变散度的散度检验能达到与Hoeffding检验相同的二阶项,但采用非不变散度的散度检验在某些备择假设Q下可能优于Hoeffding检验。这种特性有望被应用于具备备择假设Q部分先验知识的复合假设检验中,即通过调整散度检验所用的散度,使其适配可能的备择假设集合。
英文摘要:
Consider a binary statistical hypothesis testing problem, where $n$ independent and identically distributed random variables $Z^n$ are either distributed according to the null hypothesis $P$ or the alternative hypothesis $Q$, and only $P$ is known. A well-known test that is suitable for this case is the so-called Hoeffding test, which accepts $P$ if the Kullback-Leibler (KL) divergence between the empirical distribution of $Z^n$ and $P$ is below some threshold. This work characterizes the first and second-order terms of the type-II error probability for a fixed type-I error probability for the Hoeffding test as well as for divergence tests, where the KL divergence is replaced by a general divergence. It is demonstrated that, irrespective of the divergence, divergence tests achieve the first-order term of the Neyman-Pearson test, which is the optimal test when both $P$ and $Q$ are known. In contrast, the second-order term of divergence tests is strictly worse than that of the Neyman-Pearson test. It is further demonstrated that divergence tests with an invariant divergence achieve the same second-order term as the Hoeffding test, but divergence tests with a non-invariant divergence may outperform the Hoeffding test for some alternative hypotheses $Q$. Potentially, this behavior could be exploited by a composite hypothesis test with partial knowledge of the alternative hypothesis $Q$ by tailoring the divergence of the divergence test to the set of possible alternative hypotheses.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。