可疑重合与点态互信息
On Suspicious Coincidences and Pointwise Mutual Information
摘要:
Barlow(1985)假设,如果$P(A,B) \gg P(A) P(B)$,则$A$和$B$两个事件的同时发生是“可疑的”。我们首先回顾了$2 \times 2$列联表的经典关联度量,包括Yule的$Y$(Yule,1912),它只依赖于比值比$λ$,并且与表的边际概率无关。然后,我们讨论的互信息(MI)和逐点互信息(PMI),这取决于比率$P(A,B)/P(A)P(B)$,作为关联的措施。我们发现,一旦边缘的影响被删除,MI和PMI的行为类似于$Y$的功能$λ$。逐点互信息在一些研究团体中被广泛用于标记可疑的巧合,但重要的是要记住PMI对边缘的敏感性,稀疏事件的分数会增加。
英文摘要:
Barlow (1985) hypothesized that the co-occurrence of two events $A$ and $B$ is "suspicious" if $P(A,B) \gg P(A) P(B)$. We first review classical measures of association for $2 \times 2$ contingency tables, including Yule's $Y$ (Yule, 1912), which depends only on the odds ratio $λ$, and is independent of the marginal probabilities of the table. We then discuss the mutual information (MI) and pointwise mutual information (PMI), which depend on the ratio $P(A,B)/P(A)P(B)$, as measures of association. We show that, once the effect of the marginals is removed, MI and PMI behave similarly to $Y$ as functions of $λ$. The pointwise mutual information is used extensively in some research communities for flagging suspicious coincidences, but it is important to bear in mind the sensitivity of the PMI to the marginals, with increased scores for sparser events.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。