arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1508.03530cs.CLphysics.data-anphysics.soc-ph
收藏

三个变量之间统计依赖关系的信息论分析:在书面语言中的应用

Information-theoretical analysis of the statistical dependencies among three variables: Applications to written language

Centro Atómico Bariloche(巴里洛切原子中心);Instituto Balseiro(巴尔塞罗研究所)

Damián G. Hernández, Damián H. Zanette, Inés Samengo

摘要:

我们开发了研究三个变量之间的统计依赖关系所需的信息理论概念。其中一些依赖关系是纯粹的三重相互作用,从某种意义上说,它们不能用成对相关性的组合来解释。我们推导出三重依赖的界限,并描述了三个二元变量的联合概率分布的形状与高三重相互作用。该分析还允许我们量化变量对之间的互信息中的冗余量,并评估两个变量之间的信息是否由第三个变量介导。这些概念适用于书面文本的分析。我们发现,一个给定的单词被发现在一个特定的位置内的文本的概率不仅调制的存在或不存在的其他附近的话,但也,对存在或不存在的附近的单词对。我们确定的话包围的关键语义概念的文本,高成对和三重相互作用的三元组的话,和调解其他词之间的成对相互作用的话。

英文摘要:

We develop the information-theoretical concepts required to study the statistical dependencies among three variables. Some of such dependencies are pure triple interactions, in the sense that they cannot be explained in terms of a combination of pairwise correlations. We derive bounds for triple dependencies, and characterize the shape of the joint probability distribution of three binary variables with high triple interaction. The analysis also allows us to quantify the amount of redundancy in the mutual information between pairs of variables, and to assess whether the information between two variables is or is not mediated by a third variable. These concepts are applied to the analysis of written texts. We find that the probability that a given word is found in a particular location within the text is not only modulated by the presence or absence of other nearby words, but also, on the presence or absence of nearby pairs of words. We identify the words enclosing the key semantic concepts of the text, the triplets of words with high pairwise and triple interactions, and the words that mediate the pairwise interactions between other words.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑