arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2304.05129cs.ITmath.ITmath.PR
收藏

非高斯信道互信息凹性的失效

Breakdown of a concavity property of mutual information for non-Gaussian channels

Anastasia Kireeva, Jean-Christophe Mourrat

AI总结:

本文研究了两种测量场景下互信息的大小关系,证明加性高斯信道中第一种场景总是更优的性质对非高斯信道不成立,并由此推出稀疏随机块模型社区检测中的连续时间互信息在大系统极限下也不具有凹性。

摘要:

设 $S$ 和 $\ ilde S$ 为两个独立同分布的随机变量,我们将其解释为信号,并设 $P_1$ 和 $P_2$ 为两个通信信道。我们可以在两种测量场景之间进行选择:要么通过 $P_1$ 和 $P_2$ 观测 $S$,同时通过 $P_1$ 和 $P_2$ 观测 $\ ilde S$;要么通过 $P_1$ 对 $S$ 观测两次,并通过 $P_2$ 对 $\ ilde{S}$ 观测两次。在这两种场景中,哪一种能使我们获得关于信号 $(S, \ ilde S)$ 的最多信息?当 $P_1$ 和 $P_2$ 为加性高斯信道时,第一种场景总是能获得更多信息,但我们给出的例子表明,这一性质并不能推广到任意信道。作为该结果的一个推论,我们证明了在稀疏随机块模型上进行社区检测的情形下产生的连续时间互信息不是凹的,即使在大系统规模的极限下也是如此。这与平均度发散模型的情形形成对比,并为该量的渐近行为分析带来了额外的挑战。

英文摘要:

Let $S$ and $\tilde S$ be two independent and identically distributed random variables, which we interpret as the signal, and let $P_1$ and $P_2$ be two communication channels. We can choose between two measurement scenarios: either we observe $S$ through $P_1$ and $P_2$, and also $\tilde S$ through $P_1$ and $P_2$; or we observe $S$ twice through $P_1$, and $\tilde{S}$ twice through $P_2$. In which of these two scenarios do we obtain the most information on the signal $(S, \tilde S)$? While the first scenario always yields more information when $P_1$ and $P_2$ are additive Gaussian channels, we give examples showing that this property does not extend to arbitrary channels. As a consequence of this result, we show that the continuous-time mutual information arising in the setting of community detection on sparse stochastic block models is not concave, even in the limit of large system size. This stands in contrast to the case of models with diverging average degree, and brings additional challenges to the analysis of the asymptotic behavior of this quantity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑