本征格林学习:通过逆偏微分方程在流形上进行监督学习
Intrinsic Green's Learning: Supervised Learning on Manifolds via Inverse PDE
AI总结:
研究提出本征格林学习框架,通过逆偏微分方程在流形上进行监督学习。利用编码器发现低维坐标图,两阶段算法分离坐标发现与源拟合,可学习门自动发现本征维数,在合成流形和MNIST上实现近乎最优分类及本征维数自动恢复。
摘要:
我们引入了本征格林学习(IGL)框架,该框架将流形上的目标函数建模为线性偏微分方程的解,其源项从数据中学习。IGL并非直接逼近目标,而是学习一个源并将其与格林核进行积分。编码器在流形上发现低维坐标图,源和核在此处分解为低秩张量,将高维积分转化为独立的一维积分,成本与本征维数呈线性关系。两阶段算法将坐标发现与源拟合分离,源拟合是近凸线性求解,防止联合训练的维数崩溃。每个坐标上的可学习门自动发现流形的本征维数。我们在合成流形和MNIST上验证了IGL,它在该模型中同时实现了近乎最优的分类和本征维数的自动恢复。
英文摘要:
We introduce Intrinsic Green's Learning (IGL), a framework that models a target function on a manifold as the solution to a linear PDE whose source term is learned from data. Rather than approximating the target directly, IGL learns a source and integrates it against a Green's kernel. An encoder discovers a low-dimensional coordinate chart on the manifold where both the source and the kernel decompose as low-rank tensors, collapsing a high-dimensional integral into independent one-dimensional integrals with cost linear in the intrinsic dimension. A two-stage algorithm separates coordinate discovery from source fitting, a near-convex linear solve, preventing the dimensional collapse of joint training. Learnable gates on each coordinate automatically discover the intrinsic dimension of the manifold. We validate IGL on synthetic manifolds and on MNIST, where it simultaneously achieves near-optimal classification and automatic recovery of the intrinsic dimension.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。