arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.13078physics.soc-phcs.IRphysics.data-an
收藏

概率-湍流散度:一种用于比较重尾分类分布的可调谐分类度量工具

Probability-turbulence divergence: A tunable allotaxonometric instrument for comparing heavy-tailed categorical distributions

University of Vermont(佛蒙特大学);Santa Fe Institute(圣塔菲研究所);MassMutual Data Science(安联数据科学);Howard Hughes Medical Institute, Janelia Research Campus(霍华德·休斯医学研究所詹利亚研究园区);Advanced Bioimaging Center, University of California Berkeley(加州大学伯克利分校先进生物成像中心);Khoury College of Computer Sciences, Northeastern University(东北大学科里计算机学院)

P. S. Dodds, J. R. Minot, M. V. Arnold, T. Alshaabi, J. L. Adams, A. J. Reagan, C. M. Danforth

AI总结:

研究重尾分类分布比较问题,引入概率-湍流散度工具,它基于秩-湍流散度建模,更敏感于类型频率变化。构建分类图展示概率湍流,能推广多种现有距离和度量,还探讨了与其他概念的相似性及相关优化开放问题。

摘要:

现实世界的复杂系统包含多种不同类型的元素以及更多类型的元素间网络交互。当类型的相对丰度能被很好测量时,常观察到类型频率的重尾分类分布。在比较两个系统或一个系统在不同时间点的类型频率分布(分类度量的一个方面)时,有多种概率散度可用。本文引入并探索了‘概率-湍流散度’,这是一种用于比较可归一化分类频率分布的可调谐、直接且可解释的工具。我们在秩-湍流散度(RTD)之后对概率-湍流散度(PTD)进行建模。虽然概率-湍流散度在应用上比秩-湍流散度更受限,但它对类型频率变化更敏感。我们构建分类图来展示概率湍流,纳入了一种在视觉上处理仅出现在一个系统中的‘排他类型’零概率的方法。我们探索了来自文献、社交媒体和生态学的示例分布比较。我们展示了概率-湍流散度如何明确地或在功能上推广了许多现有的距离和度量,包括特殊情况下的\(L^{(p)}\)范数、 Sørensen-Dice系数(\(F_{1}\)统计量)和Hellinger距离。我们讨论了与Rényi和Tsallis广义熵以及生态学中多样性指数(或Hill数)的相似性。最后我们思考了关于秩-和概率-湍流散度调优优化的开放问题。

英文摘要:

Real-world complex systems often comprise many distinct types of elements as well as many more types of networked interactions between elements. When the relative abundances of types can be measured well, we often observe heavy-tailed categorical distributions for type frequencies. For the comparison of type frequency distributions of two systems or a system with itself at different time points in time -- a facet of allotaxonometry -- a great range of probability divergences are available. Here, we introduce and explore `probability-turbulence divergence', a tunable, straightforward, and interpretable instrument for comparing normalizable categorical frequency distributions. We model probability-turbulence divergence (PTD) after rank-turbulence divergence (RTD). While probability-turbulence divergence is more limited in application than rank-turbulence divergence, it is more sensitive to changes in type frequency. We build allotaxonographs to display probability turbulence, incorporating a way to visually accommodate zero probabilities for `exclusive types' which are types that appear in only one system. We explore comparisons of example distributions taken from literature, social media, and ecology. We show how probability-turbulence divergence either explicitly or functionally generalizes many existing kinds of distances and measures, including, as special cases, $L^{(p)}$ norms, the Sørensen-Dice coefficient (the $F_{1}$ statistic), and the Hellinger distance. We discuss similarities with the generalized entropies of R{é}nyi and Tsallis, and the diversity indices (or Hill numbers) from ecology. We close with thoughts on open problems concerning the optimization of the tuning of rank- and probability-turbulence divergence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑