arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.21846stat.MLcs.LGmath.STstat.MEstat.TH
收藏

可扩展的基于核的距离用于统计推断和整合

Scalable Kernel-Based Distances for Statistical Inference and Integration

University College London(伦敦大学学院)

Masha Naslidnyk

AI总结:

本研究提出改进的MMD估计器和核分位数不一致,用于统计推断和整合任务,提升计算效率和鲁棒性。

摘要:

在计算统计学和机器学习中,表示、比较和测量概率分布之间的距离是一个关键任务。选择的表示方法和相关的距离决定了它们在其中使用的方法的性质:例如,某些距离可以允许编码问题的鲁棒性或平滑性。核方法提供了灵活且丰富的希尔伯特空间表示,允许建模者通过选择核来强制某些属性,并以非参数速率估计相关距离。特别是,最大均值分歧(MMD),一种通过比较希尔伯特空间均值函数构建的基于核的距离,由于其计算的可处理性而受到广泛关注,并受到实践者的青睐。\n在本论文中,我们对基于核的距离进行了深入研究,重点是高效的计算,核心贡献在第3到第6章。第一部分专注于MMD,特别是改进的MMD估计。在第3章中,我们提出了一种在基于模拟的推断中理论上严谨的改进MMD估计器。然后在第4章中,我们提出了一种基于MMD的条件期望估计器,这是统计计算中普遍的任务。结束第一部分,在第5章中,我们研究了当MMD应用于整合任务时的校准问题。\n在第二部分中,受最近在核嵌入方面的进展启发,我们引入了一种新的核基于的不一致:核分位数不一致。这些解决了MMD的一些缺点,并通过理论结果和实证研究展示,提供了一种与MMD及其快速近似相竞争的替代方案。最后,我们讨论了来自本论文的更广泛的启示和未来工作。

英文摘要:

Representing, comparing, and measuring the distance between probability distributions is a key task in computational statistics and machine learning. The choice of representation and the associated distance determine properties of the methods in which they are used: for example, certain distances can allow one to encode robustness or smoothness of the problem. Kernel methods offer flexible and rich Hilbert space representations of distributions that allow the modeller to enforce properties through the choice of kernel, and estimate associated distances at efficient nonparametric rates. In particular, the maximum mean discrepancy (MMD), a kernel-based distance constructed by comparing Hilbert space mean functions, has received significant attention due to its computational tractability and is favoured by practitioners. In this thesis, we conduct a thorough study of kernel-based distances with a focus on efficient computation, with core contributions in Chapters 3 to 6. Part I of the thesis is focused on the MMD, specifically on improved MMD estimation. In Chapter 3 we propose a theoretically sound, improved estimator for MMD in simulation-based inference. Then, in Chapter 4, we propose an MMD-based estimator for conditional expectations, a ubiquitous task in statistical computation. Closing Part I, in Chapter 5 we study the problem of calibration when MMD is applied to the task of integration. In Part II, motivated by the recent developments in kernel embeddings beyond the mean, we introduce a family of novel kernel-based discrepancies: kernel quantile discrepancies. These address some of the pitfalls of MMD, and are shown through both theoretical results and an empirical study to offer a competitive alternative to MMD and its fast approximations. We conclude with a discussion on broader lessons and future work emerging from the thesis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑