经验概率在相对熵中的Dupff型集中
Chernoff-type Concentration of Empirical Probabilities in Relative Entropy
摘要:
我们研究了$k$类别的多项式抽样中经验概率向量相对于真实概率向量的相对熵,当乘以样本量$n$时,它也是对数似然比统计量。我们推广了最近的一个结果,并表明,矩母函数的统计量是有界的多项式的次数$n$的单位区间上,一致的所有真概率向量。我们刻画了以$(k,n)$为指标的多项式族,并得到了显式公式.因此,我们开发了一个封闭形式的版本,从一个大样本扩展的边界极小化的Bauffff型的尾部边界。我们的界限占主导地位的经典方法的类型的界限,并与国家的最先进的竞争力。我们证明了应用估计的比例看不见的蝴蝶。
英文摘要:
We study the relative entropy of the empirical probability vector with respect to the true probability vector in multinomial sampling of $k$ categories, which, when multiplied by sample size $n$, is also the log-likelihood ratio statistic. We generalize a recent result and show that the moment generating function of the statistic is bounded by a polynomial of degree $n$ on the unit interval, uniformly over all true probability vectors. We characterize the family of polynomials indexed by $(k,n)$ and obtain explicit formulae. Consequently, we develop Chernoff-type tail bounds, including a closed-form version from a large sample expansion of the bound minimizer. Our bound dominates the classic method-of-types bound and is competitive with the state of the art. We demonstrate with an application to estimating the proportion of unseen butterflies.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。