arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.10641stat.MEcs.LGmath.STstat.TH
收藏

调整相似度度量与期望的违反

Adjusted Similarity Measures and a Violation of Expectations

William L. Lippitt, Edward J. Bedrick, Nichole E. Carlson

AI总结:

本文研究了调整相似度度量的通用方法,并探讨了空模型对调整操作符的影响,指出违反充分条件可能导致度量失效。

摘要:

调整相似度度量,例如Cohen的Kappa用于衡量不同评分者的一致性以及调整后的Rand指数用于比较聚类算法,是比较离散标签的重要工具。这些度量旨在具有在空分布下期望为0和在最大相似性下最大值为1的性质,以帮助解释。度量经常根据排列分布进行调整,这是出于历史和分析原因。目前,对于其他更合适的空模型的考虑正在重新引起兴趣,例如允许随机确定簇数的聚类集合。本工作的目的是双重的:(1)将调整操作符的研究推广到一般空模型以及更一般的过程,该过程包括统计标准化作为特殊情况;(2)确定调整操作符产生预期性质的充分条件,其中充分条件与观察数据如何纳入空分布有关。我们展示了违反充分条件可能导致重大破坏,例如通过在传统调整下产生非正度量而不是具有均值为0的度量,或者通过产生在统计标准化下确定性为0的度量。

英文摘要:

Adjusted similarity measures, such as Cohen's kappa for inter-rater reliability and the adjusted Rand index used to compare clustering algorithms, are a vital tool for comparing discrete labellings. These measures are intended to have the property of 0 expectation under a null distribution and maximum value 1 under maximal similarity to aid in interpretation. Measures are frequently adjusted with respect to the permutation distribution for historic and analytic reasons. There is currently renewed interest in considering other null models more appropriate for context, such as clustering ensembles permitting a random number of identified clusters. The purpose of this work is two -- fold: (1) to generalize the study of the adjustment operator to general null models and to a more general procedure which includes statistical standardization as a special case and (2) to identify sufficient conditions for the adjustment operator to produce the intended properties, where sufficient conditions are related to whether and how observed data are incorporated into null distributions. We demonstrate how violations of the sufficient conditions may lead to substantial breakdown, such as by producing a non-positive measure under traditional adjustment rather than one with mean 0, or by producing a measure which is deterministically 0 under statistical standardization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑