Debiaser当心:居中正则化传输映射的陷阱
Debiaser Beware: Pitfalls of Centering Regularized Transport Maps
摘要:
估计最优输运(OT)地图(也称为Monge映射)是一个充满计算和统计挑战的问题。一个有前途的方法是使用双势函数时,解决样本$P_n$和$Q_n$之间的熵正则化OT问题,它可以用来恢复一个近似最优的地图。然而,该方案中的负熵惩罚引入了随着正则化强度而增长的估计偏差。一个众所周知的消除这种估计偏差的方法,在正则化优选论的实践者中得到了广泛的欢迎,就是通过减去涉及$P_n$和它本身以及$Q_n$和它本身的辅助问题来使它们居中。我们证明,在有利的条件下,$P$和$Q$,去偏可以产生更好的近似蒙赫地图。然而,也许令人惊讶的是,我们提出了一些情况下,去偏置是证明有害的统计意义上,特别是当正则化强度是大的或样本的样本个数是小的。这些主张在合成和真实数据集上得到了实验验证,并且应该重新开启关于使用熵最优输运时是否需要去偏的辩论。
英文摘要:
Estimating optimal transport (OT) maps (a.k.a. Monge maps) between two measures $P$ and $Q$ is a problem fraught with computational and statistical challenges. A promising approach lies in using the dual potential functions obtained when solving an entropy-regularized OT problem between samples $P_n$ and $Q_n$, which can be used to recover an approximately optimal map. The negentropy penalization in that scheme introduces, however, an estimation bias that grows with the regularization strength. A well-known remedy to debias such estimates, which has gained wide popularity among practitioners of regularized OT, is to center them, by subtracting auxiliary problems involving $P_n$ and itself, as well as $Q_n$ and itself. We do prove that, under favorable conditions on $P$ and $Q$, debiasing can yield better approximations to the Monge map. However, and perhaps surprisingly, we present a few cases in which debiasing is provably detrimental in a statistical sense, notably when the regularization strength is large or the number of samples is small. These claims are validated experimentally on synthetic and real datasets, and should reopen the debate on whether debiasing is needed when using entropic optimal transport.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。