arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2111.01767stat.MLcs.LGstat.ME
收藏

基于置换群上指数族先验的混洗数据正则化

Regularization for Shuffled Data Problems via Exponential Family Priors on the Permutation Group

George Mason University(乔治梅森大学);U.S. Census Bureau(美国人口普查局)

Zhenbang Wang, Emanuel Ben-David, Martin Slawski

摘要:

在分析由(X,Y)对组成的数据集时,一个默认的假设是每个对对应于相同的观察单元。然而,如果这样的对是通过两个文件的记录链接获得的,则由于不匹配错误根源(例如,在两个文件中缺乏可靠的标识符),可能违反该假设。最近,在术语“混洗数据”下,对这种设置的兴趣激增,其中(X,Y)对的潜在正确配对通过未知索引排列表示。置换的显式建模往往与大量的过拟合相关联,这促使需要合适的正则化方法。在本文中,我们提出了一个灵活的指数家庭事先置换群,可用于整合各种结构,如稀疏和局部约束洗牌。这个先验证明是共轭的典型洗牌数据的问题,其中的可能性条件的固定排列可以表示为产品在相应的(X,Y)对。推理是基于期望最大化算法,其中棘手的E-步骤是近似的Fisher-Yates算法。如果(X,Y)-对的似然函数具有指数族形式,则M-步可以将$n^2$显著地减少到$n$项,这与广义线性模型的情形相同.合成和真实数据的比较表明,所提出的方法优于竞争的方法。

英文摘要:

In the analysis of data sets consisting of (X, Y)-pairs, a tacit assumption is that each pair corresponds to the same observation unit. If, however, such pairs are obtained via record linkage of two files, this assumption can be violated as a result of mismatch error rooting, for example, in the lack of reliable identifiers in the two files. Recently, there has been a surge of interest in this setting under the term "Shuffled data" in which the underlying correct pairing of (X, Y)-pairs is represented via an unknown index permutation. Explicit modeling of the permutation tends to be associated with substantial overfitting, prompting the need for suitable methods of regularization. In this paper, we propose a flexible exponential family prior on the permutation group for this purpose that can be used to integrate various structures such as sparse and locally constrained shuffling. This prior turns out to be conjugate for canonical shuffled data problems in which the likelihood conditional on a fixed permutation can be expressed as product over the corresponding (X,Y)-pairs. Inference is based on the EM algorithm in which the intractable E-step is approximated by the Fisher-Yates algorithm. The M-step is shown to admit a significant reduction from $n^2$ to $n$ terms if the likelihood of (X,Y)-pairs has exponential family form as in the case of generalized linear models. Comparisons on synthetic and real data show that the proposed approach compares favorably to competing methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑