arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.10656cs.ITmath.IT
收藏

Rényi散度强数据处理常数的性质

Properties of the Strong Data Processing Constant for Rényi Divergence

Lifu Jin, Amedeo Roberto Esposito, Michael Gastpar

AI总结:

本文研究Rényi散度的强数据处理常数,证明其满足卡方散度SDPI常数对应的通用下界,刻画α=2时取上确界的分布并算出一般二元信道下的SDPI常数。

摘要:

强数据处理不等式(SDPI)是信息论中的重要研究对象,针对$f$-散度的相关研究已较为充分。现有研究已给出其通用上下界及多种应用,将其与不可能性(逆)结果、测度集中性、超压缩性等问题相关联。本文研究Rényi散度及其对应的SDPI常数,该常数的表现与常规$Φ$-散度的SDPI常数存在差异:已有示例表明,将其SDPI常数与总变差散度SDPI常数关联的通用上界通常不成立。但本文证明,涉及卡方散度SDPI常数的通用下界对Rényi散度是成立的。此外,本文还刻画了$α$等于2时达到上确界的分布特征,并由此计算出一般二元信道下Rényi散度的SDPI常数。

英文摘要:

Strong data processing inequalities (SDPI) are an important object of study in Information Theory and have been well studied for $f$-divergences. Universal upper and lower bounds have been provided along with several applications, connecting them to impossibility (converse) results, concentration of measure, hypercontractivity, and so on. In this paper, we study Rényi divergence and the corresponding SDPI constant whose behavior seems to deviate from that of ordinary $Φ$-divergences. In particular, one can find examples showing that the universal upper bound relating its SDPI constant to the one of Total Variation does not hold in general. In this work, we prove, however, that the universal lower bound involving the SDPI constant of the Chi-square divergence does indeed hold. Furthermore, we also provide a characterization of the distribution that achieves the supremum when $α$ is equal to $2$ and consequently compute the SDPI constant for Rényi divergence of the general binary channel.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑