$L_1$球的补的最小KL-发散
Minimum KL-divergence on complements of $L_1$ balls
摘要:
利用Kullback-Leibler散度$D(P||Q)$给出了总变差距离$||P-Q||_1$的Pinsker不等式上界。虽然一般来说,在相反方向上的界限是不可能的,但在许多应用中,感兴趣的量实际上是$D^*(P,\eps)$ -对于任意固定的$P$,定义为$D(P||Q)$在所有分布$Q$上的下确界,这些分布是$\eps$ --在总变差上远离$P$。我们证明了$D^*(P,\eps)\le C\eps^2 + O(\eps^3)$,其中$C=C(P)=1/2$为“平衡”分布,从而提供了一种反向Pinsker不等式。大偏差的应用,并给出了一些结构的结果可能是独立的利益。关键词:Pinsker不等式,Sanov定理,大偏差
英文摘要:
Pinsker's widely used inequality upper-bounds the total variation distance $||P-Q||_1$ in terms of the Kullback-Leibler divergence $D(P||Q)$. Although in general a bound in the reverse direction is impossible, in many applications the quantity of interest is actually $D^*(P,\eps)$ --- defined, for an arbitrary fixed $P$, as the infimum of $D(P||Q)$ over all distributions $Q$ that are $\eps$-far away from $P$ in total variation. We show that $D^*(P,\eps)\le C\eps^2 + O(\eps^3)$, where $C=C(P)=1/2$ for "balanced" distributions, thereby providing a kind of reverse Pinsker inequality. An application to large deviations is given, and some of the structural results may be of independent interest. Keywords: Pinsker inequality, Sanov's theorem, large deviations
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。