arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.00737cs.ITmath.AGmath.ITphysics.bio-phq-bio.NC
收藏

相关性如何塑造信息的景观?

How do correlations shape the landscape of information?

Ching-Peng Huang

AI总结:

本文利用代数几何方法分析香农互信息在固定边际分布下的模型,将概率单纯形划分为环面腔室并计算体积,同时建立级数展开与部分信息分解间的联系,以促进数学与理论神经科学的交流。

摘要:

我们探讨了关于相关性如何影响信息的几个常见模型。所考虑的主要模型是香农互信息 $I(S:R_1,\cdots, R_i)$,其分布具有固定的边际分布 $P_{S,R_i}$(对每个 $i$),其中 $S$ 类比为刺激,$R_i$ 类比为神经元。我们使用代数几何工具详细推导了基本模型,写出了在概率单纯形中将具有不同定性行为的分布分离成环面腔室的判别式,并代数地评估了这些腔室的体积。作为副产品,我们提供了由级数展开启发的互信息分解与部分信息分解(PID)问题中的分解之间的直接转换,表征了前者的协同项。我们希望本文能促进社区之间的交流,特别是数学与理论神经科学之间在该主题上的交流。

英文摘要:

We explore a few common models on how correlations affect information. The main model considered is the Shannon mutual information $I(S:R_1,\cdots, R_i)$ over distributions with marginals $P_{S,R_i}$ fixed for each $i$, with the analogy in which $S$ is the stimulus and $R_i$'s are neurons. We work out basic models in details, using algebro-geometric tools to write down discriminants that separate distributions with distinct qualitative behaviours in the probability simplex into toric chambers and evaluate the volumes of them algebraically. As a byproduct, we provide direct translation between a decomposition of mutual information inspired by a series expansion and one from partial information decomposition (PID) problems, characterising the synergistic terms of the former. We hope this paper serves for communication between communities especially mathematics and theoretical neuroscience on the topic. KEYWORDS: information theory, algebraic statistics, mathematical neuroscience, partial information decomposition

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑