arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2211.01788cs.ITmath.ITmath.PR
收藏

公共信息、噪声稳定性及其扩展

Common Information, Noise Stability, and Their Extensions

Lei Yu, Vincent Y. F. Tan

摘要:

公共信息(CI)在信息论和相关领域如理论计算机科学和离散概率中是普遍存在的。然而,由于CI的概念多种多样,对它们之间的深层联系缺乏统一的理解。这本专著试图填补这一空白,利用一小套数学技术,适用于在看似不同的问题。在第一部分中,我们回顾了与Wyner和Gács-Körner-Witsenhausen(GKW)CI相关的操作任务和性质。在第二部分中,我们从分布源模拟的角度讨论了前者的扩展。这包括Rényi CI,它形成了Wyner CI和精确CI之间的桥梁。通过~ $\infty$阶的Rényi CI和精确CI之间令人惊讶的等价性,我们证明了存在一个联合源,其中精确CI严格超过Wyner的CI.第二部分讨论的其他密切相关的主题包括通道合成问题和Wyner和精确CI与矩阵的非负秩的连接。在第三部分中,我们通过噪声稳定性或NICD问题来研究GKW的CI,在该问题中,我们量化了从双变量源中提取的位的协议概率。然后,我们将其扩展到$k$ -用户NICD和$q$ -稳定性问题,并讨论了各种在信息论和离散概率,如Courtade-Kumar,Li-Médard和Mossell-O 'Donnell的代数。最后,我们考虑了超压缩性和Brascamp-Lieb不等式,通过用非负函数代替其中的布尔函数,进一步推广了噪声稳定性。第三部分中的证明背后的关键思想可以通过信息论和傅立叶分析方法以教学上连贯的方式呈现和统一。

英文摘要:

Common information (CI) is ubiquitous in information theory and related areas such as theoretical computer science and discrete probability. However, because there are multiple notions of CI, a unified understanding of the deep interconnections between them is lacking. This monograph seeks to fill this gap by leveraging a small set of mathematical techniques that are applicable across seemingly disparate problems. In Part I, we review the operational tasks and properties associated with Wyner's and Gács-Körner-Witsenhausen's (GKW's) CI. In PartII, we discuss extensions of the former from the perspective of distributed source simulation. This includes the Rényi CI which forms a bridge between Wyner's CI and the exact CI. Via a surprising equivalence between the Rényi CI of order~$\infty$ and the exact CI, we demonstrate the existence of a joint source in which the exact CI strictly exceeds Wyner's CI. Other closely related topics discussed in Part II include the channel synthesis problem and the connection of Wyner's and exact CI to the nonnegative rank of matrices. In Part III, we examine GKW's CI with a more refined lens via the noise stability or NICD problem in which we quantify the agreement probability of extracted bits from a bivariate source. We then extend this to the $k$-user NICD and $q$-stability problems, and discuss various conjectures in information theory and discrete probability, such as the Courtade-Kumar, Li-Médard and Mossell-O'Donnell conjectures. Finally, we consider hypercontractivity and Brascamp-Lieb inequalities, which further generalize noise stability via replacing the Boolean functions therein by nonnnegative functions. The key ideas behind the proofs in Part III can be presented in a pedagogically coherent manner and unified via information-theoretic and Fourier-analytic methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑