arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1010.2043math.STstat.TH
收藏

相对对数与一对三角不等式

Relative log-concavity and a pair of triangle inequalities

Yaming Yu

摘要:

研究了非负整数上概率质量函数之间的相对对数序$\leq_{\mathrm{lc}}$。给定三个满足$f\leq_{\mathrm{lc}}g\leq_{\mathrm{lc}}h$的pmf的$f,g,h$,我们给出了一对(反向)三角不等式:如果$\sum_iif_i=\sum_iig_i<\infty,$则\[D(f|h)\geq D(f|g)+D(g|h)\],如果$\sum_iig_i=\sum_iih_i<\infty,$则\[D(h|f)\geq D(h|g)+D(g|f),\],其中$D(\cdot|\cdot)$表示Kullback-Leibler散度.这些不等式,有趣的本身,也适用于几个问题,包括最大熵的泊松分布和二项式分布的特征和最佳二项式近似相对熵。我们还提出了连续分布的并行结果,并讨论了卷积下的$\leq_{\mathrm{lc}}$的行为。

英文摘要:

The relative log-concavity ordering $\leq_{\mathrm{lc}}$ between probability mass functions (pmf's) on non-negative integers is studied. Given three pmf's $f,g,h$ that satisfy $f\leq_{\mathrm{lc}}g\leq_{\mathrm{lc}}h$, we present a pair of (reverse) triangle inequalities: if $\sum_iif_i=\sum_iig_i<\infty,$ then \[D(f|h)\geq D(f|g)+D(g|h)\] and if $\sum_iig_i=\sum_iih_i<\infty,$ then \[D(h|f)\geq D(h|g)+D(g|f),\] where $D(\cdot|\cdot)$ denotes the Kullback--Leibler divergence. These inequalities, interesting in themselves, are also applied to several problems, including maximum entropy characterizations of Poisson and binomial distributions and the best binomial approximation in relative entropy. We also present parallel results for continuous distributions and discuss the behavior of $\leq_{\mathrm{lc}}$ under convolution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑