arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 0706.1062physics.data-ancond-mat.dis-nnstat.APstat.ME
收藏

经验数据中的幂律分布

Power-law distributions in empirical data

Aaron Clauset, Cosma Rohilla Shalizi, M. E. J. Newman

摘要:

幂律分布出现在许多科学感兴趣的情况下,并对我们理解自然和人为现象产生重大影响。不幸的是,幂律的检测和表征是复杂的,因为分布的尾部(代表大但罕见的事件的分布部分)发生了大的波动,并且很难确定幂律行为的范围。分析幂律数据的常用方法,如最小二乘拟合,可能会对幂律分布的参数产生相当不准确的估计,即使在这种方法返回准确答案的情况下,它们仍然不能令人满意,因为它们根本没有给出数据是否服从幂律的指示。在这里,我们提出了一个原则性的统计框架,用于识别和量化经验数据中的幂律行为。我们的方法结合了最大似然拟合方法与拟合优度测试的基础上的Kolmogorov-Smirnov统计量和似然比。我们评估的有效性的方法与合成数据的测试,并给出关键的比较,以前的方法。我们还将所提出的方法应用于24个来自不同学科的真实数据集,每个数据集都被证明遵循幂律分布。在某些情况下,我们发现这些结构与数据一致,而在其他情况下,幂律被排除在外。

英文摘要:

Power-law distributions occur in many situations of scientific interest and have significant consequences for our understanding of natural and man-made phenomena. Unfortunately, the detection and characterization of power laws is complicated by the large fluctuations that occur in the tail of the distribution -- the part of the distribution representing large but rare events -- and by the difficulty of identifying the range over which power-law behavior holds. Commonly used methods for analyzing power-law data, such as least-squares fitting, can produce substantially inaccurate estimates of parameters for power-law distributions, and even in cases where such methods return accurate answers they are still unsatisfactory because they give no indication of whether the data obey a power law at all. Here we present a principled statistical framework for discerning and quantifying power-law behavior in empirical data. Our approach combines maximum-likelihood fitting methods with goodness-of-fit tests based on the Kolmogorov-Smirnov statistic and likelihood ratios. We evaluate the effectiveness of the approach with tests on synthetic data and give critical comparisons to previous approaches. We also apply the proposed methods to twenty-four real-world data sets from a range of different disciplines, each of which has been conjectured to follow a power-law distribution. In some cases we find these conjectures to be consistent with the data while in others the power law is ruled out.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑