具有已知平均值和两两关联的二元系统的最小和最大熵分布
Minimum and maximum entropy distributions for binary systems with known means and pairwise correlations
摘要:
最大熵模型越来越多地被用来描述集体活动的神经群体与测量的平均神经活动和成对的相关性,但与这些约束一致的概率分布的整个空间还没有被探索。我们提供了上界和下界的熵的{ \em最小}熵分布在任意大的集合的二进制单位与任何固定的平均值和成对的相关性。我们还构建了几个相关的情况下,具体的低熵分布。令人惊讶的是,最小熵的解决方案具有熵缩放与系统大小的任何一组一阶和二阶统计与任意大的系统一致。我们进一步证明,这些低阶统计量的某些集合只能通过小系统来实现。我们的研究结果表明,如何只有少量的随机性需要模仿低阶统计特性的高熵分布,我们讨论了一些工程和生物信息传输系统的应用。
英文摘要:
Maximum entropy models are increasingly being used to describe the collective activity of neural populations with measured mean neural activities and pairwise correlations, but the full space of probability distributions consistent with these constraints has not been explored. We provide upper and lower bounds on the entropy for the {\em minimum} entropy distribution over arbitrarily large collections of binary units with any fixed set of mean values and pairwise correlations. We also construct specific low-entropy distributions for several relevant cases. Surprisingly, the minimum entropy solution has entropy scaling logarithmically with system size for any set of first- and second-order statistics consistent with arbitrarily large systems. We further demonstrate that some sets of these low-order statistics can only be realized by small systems. Our results show how only small amounts of randomness are needed to mimic low-order statistical properties of highly entropic distributions, and we discuss some applications for engineered and biological information transmission systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。