arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1605.09522stat.MLcs.LG
收藏

分布的核均值嵌入:综述及展望

Kernel Mean Embedding of Distributions: A Review and Beyond

Mahidol University(玛希隆大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Institute of Statistical Mathematics(统计数学研究所);Pennsylvania State University(宾夕法尼亚州立大学)

Krikamol Muandet, Kenji Fukumizu, Bharath Sriperumbudur, Bernhard Schölkopf

摘要:

分布的希尔伯特空间嵌入--简而言之,核均值嵌入--最近已经成为机器学习和推理的强大工具。这个框架背后的基本思想是将分布映射到一个再生核希尔伯特空间(RKHS),其中整个核方法库可以扩展到概率测度。它可以被看作是支持向量机(SVM)和其他核方法共同的原始“特征图”的推广。虽然最初与后者密切相关,但它同时在从内核机器和概率建模到统计推断,因果发现和深度学习的领域中找到了应用。本次调查的目的是全面回顾现有的工作和最新进展,在这一研究领域,并讨论最具挑战性的问题和开放的问题,可能会导致新的研究方向。该调查首先简要介绍了RKHS和正定内核,形成了这次调查的骨干,其次是一个彻底的讨论希尔伯特空间嵌入的边缘分布,理论保证,并审查其应用。分布的嵌入使我们能够将RKHS方法应用于概率测度,这促使了广泛的应用,如核双样本测试,独立测试和分布数据的学习。接下来,我们讨论了条件分布的Hilbert空间嵌入,给出了理论见解,并回顾了一些应用。条件均值嵌入使我们能够以非参数的方式执行求和,乘积和贝叶斯规则-这些规则在图形模型,概率推理和强化学习中无处不在。然后,我们讨论这个框架和其他相关领域之间的关系。最后,我们对未来的研究方向提出了一些建议。

英文摘要:

A Hilbert space embedding of a distribution---in short, a kernel mean embedding---has recently emerged as a powerful tool for machine learning and inference. The basic idea behind this framework is to map distributions into a reproducing kernel Hilbert space (RKHS) in which the whole arsenal of kernel methods can be extended to probability measures. It can be viewed as a generalization of the original "feature map" common to support vector machines (SVMs) and other kernel methods. While initially closely associated with the latter, it has meanwhile found application in fields ranging from kernel machines and probabilistic modeling to statistical inference, causal discovery, and deep learning. The goal of this survey is to give a comprehensive review of existing work and recent advances in this research area, and to discuss the most challenging issues and open problems that could lead to new research directions. The survey begins with a brief introduction to the RKHS and positive definite kernels which forms the backbone of this survey, followed by a thorough discussion of the Hilbert space embedding of marginal distributions, theoretical guarantees, and a review of its applications. The embedding of distributions enables us to apply RKHS methods to probability measures which prompts a wide range of applications such as kernel two-sample testing, independent testing, and learning on distributional data. Next, we discuss the Hilbert space embedding for conditional distributions, give theoretical insights, and review some applications. The conditional mean embedding enables us to perform sum, product, and Bayes' rules---which are ubiquitous in graphical model, probabilistic inference, and reinforcement learning---in a non-parametric way. We then discuss relationships between this framework and other related areas. Lastly, we give some suggestions on future research directions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑