arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1406.5064math.SPcs.NAmath.NA
收藏

可变带宽扩散核

Variable Bandwidth Diffusion Kernels

the Pennsylvania State University(宾夕法尼亚州立大学)

Tyrus Berry, John Harlim

AI总结:

本文研究可变带宽核在扩散映射和拉普拉斯特征映射中的渐近展开,推导了离散算子的点误差估计,揭示小采样密度导致大误差的问题,并通过数值验证展示了可变带宽核在非紧致和紧致流形上的应用效果。

摘要:

实用的核方法常使用可变带宽核,也称为自调节核,但现有核方法理论仅适用于固定带宽核。本文推导了任意带宽函数的可变带宽核的渐近展开,推广了扩散映射和拉普拉斯特征映射的理论。我们还推导了基于有限数据集的相应离散算子的点误差估计,推广了Singer的结果,该结果仅限于固定带宽核。我们的分析揭示了小采样密度区域导致大误差,特别是对于固定带宽核。我们通过展示当采样密度不远离零(意味着数据位于开集)时,固定带宽核的误差估计将无界,说明现有理论在紧致流形上的局限性。我们通过选择与采样密度成反比的带宽函数(可以从数据估计)来克服这一限制,从而在非紧致流形上控制误差估计。我们通过构造奥本-乌尔申贝克过程的生成元在实线和二维平面上的示例,验证了这些结果在非紧致流形上的应用。我们还通过构造单位圆和单位球的拉普拉斯算子,验证了在紧致流形上的结果,并展示了可变带宽核对带宽选择的敏感性降低以及自动带宽选择算法的更好效果。

英文摘要:

Practical applications of kernel methods often use variable bandwidth kernels, also known as self-tuning kernels, however much of the current theory of kernel based techniques is only applicable to fixed bandwidth kernels. In this paper, we derive the asymptotic expansion of these variable bandwidth kernels for arbitrary bandwidth functions; generalizing the theory of Diffusion Maps and Laplacian Eigenmaps. We also derive pointwise error estimates for the corresponding discrete operators which are based on finite data sets; generalizing a result of Singer which was restricted to fixed bandwidth kernels. Our analysis reveals how areas of small sampling density lead to large errors, particularly for fixed bandwidth kernels. We explain the limitation of the existing theory to data sampled from compact manifolds by showing that when the sampling density is not bounded away from zero (which implies that the data lies on an open set) the error estimates for fixed bandwidth kernels will be unbounded. We show that this limitation can be overcome by choosing a bandwidth function inversely proportional to the sampling density (which can be estimated from data) which allows us to control the error estimates uniformly over a non-compact manifold. We numerically verify these results on non-compact manifolds by constructing the generator of the Ornstein-Uhlenbeck process on a real line and a two-dimensional plane using data sampled independently from the respective invariant measures. We also verify our results on compact manifolds by constructing the Laplacian on the unit circle and the unit sphere and we show that the variable bandwidth kernels exhibit reduced sensitivity to bandwidth selection and give better results for an automatic bandwidth selection algorithm.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑