arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1601.06780cs.ITmath.ITq-bio.OT
收藏

多元信息测度:子集格上的Möbius算子统一

Multivariate information measures: a unification using Möbius operators on subset lattices

David J. Galas, Nikita A. Sakhanenko

摘要:

信息相关度量是多变量数据分析的有用工具,可以作为变量间相关性的度量,也可以作为生物和物理系统中有序性的描述。与信息相关的度量,如边际熵、互信息、交互信息、多信息等,已被广泛应用于系统复杂性描述和生物数据分析等领域。因此,这些措施之间的数学关系是显着的利益。公共信息测度之间的关系包括基于格上莫比乌斯反演的对偶关系。这些是变量集(按包含排序的子集)的格的对称性的直接结果。虽然这些信息相关的措施之间的数学性质和关系是显着的兴趣,有,据我们所知,没有系统的检查的全方位的关系,并没有统一的这一不同范围的功能到一个单一的形式主义,因为我们在这里做。在本文中,我们基于莫比乌斯反演思想定义了这些格上的函数上的算子,这些算子将函数映射到另一个(莫比乌斯算子)。我们表明,这些运营商形成一个简单的群同构的对称群S3。格上的一组函数之间的关系是透明地表示在运营商代数,并适用于信息措施,可以用来获得广泛的措施之间的关系。我们描述了条件对数似然和先前定义的依赖措施之间的直接关系。代数是自然推广,从而产生更广泛的关系。这种形式主义提供了一个基本的统一的信息相关的措施,但同构的所有分配格的子集格意味着广泛的潜在应用这些结果。

英文摘要:

Information related measures are useful tools for multi variable data analysis, as measures of dependence among variables, and as descriptions of order in biological and physical systems. Information related measures, like marginal entropies, mutual / interaction / multi-information, have been used in a number of fields including descriptions of systems complexity and biological data analysis. The mathematical relationships among these measures are therefore of significant interest. Relations between common information measures include the duality relations based on Möbius inversion on lattices. These are the direct consequence of the symmetries of the lattices of the sets of variables (subsets ordered by inclusion). While the mathematical properties and relationships among these information-related measures are of significant interest, there has been, to our knowledge, no systematic examination of the full range of relationships and no unification of this diverse range of functions into a single formalism as we do here. In this paper we define operators on functions on these lattices based on the Möbius inversion idea that map the functions into one another (Möbius operators.) We show that these operators form a simple group isomorphic to the symmetric group S3. Relations among the set of functions on the lattice are transparently expressed in terms of the operator algebra, and, applied to the information measures, can be used to derive a wide range of relationships among measures. We describe a direct relation between sums of conditional log-likelihoods and previously defined dependency measures. The algebra is naturally generalized which yields more extensive relationships. This formalism provides a fundamental unification of information related measures, but isomorphism of all distributive lattices with the subset lattice implies broad potential application of these results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑