通过随机扩散在流形上实现带有正交约束的全局优化
Global Optimization with Orthogonality Constraints via Stochastic Diffusion on Manifold
AI总结:
本文提出了一种基于随机微分方程在Stiefel流形上构造噪声梯度流的方法,用于解决带有正交约束的全局优化问题,通过Cayley变换实现高效数值模拟,并证明了算法在二次连续性下的收敛性。
摘要:
带有正交约束的优化在科学和工程应用中被广泛使用。由于非凸的正交约束,许多数值算法往往难以达到全局最优。本文旨在建立一种高效的方案,以在单个或多个正交约束下寻找全局极小值。主要概念基于从随机微分方程(SDE)在Stiefel流形上构造的噪声梯度流,这是正交约束的微分几何特征化。我们推导了在带有标准度量的Stiefel流形上SDE的显式表示,并提出了一种数值高效的方案来模拟此SDE,基于Cayley变换,具有理论收敛保证。在二次连续性下证明了收敛到全局最优解。所提出算法的有效性和效率在各种问题上得到了验证,包括同质多项式优化、稳定性数计算以及从共同线在冷冻电镜中的3D结构确定。
英文摘要:
Orthogonality constrained optimization is widely used in applications from science and engineering. Due to the nonconvex orthogonality constraints, many numerical algorithms often can hardly achieve the global optimality. We aim at establishing an efficient scheme for finding global minimizers under one or more orthogonality constraints. The main concept is based on noisy gradient flow constructed from stochastic differential equations (SDE) on the Stiefel manifold, the differential geometric characterization of orthogonality constraints. We derive an explicit representation of SDE on the Stiefel manifold endowed with a canonical metric and propose a numerically efficient scheme to simulate this SDE based on Cayley transformation with theoretical convergence guarantee. The convergence to global optimizers is proved under second-order continuity. The effectiveness and efficiency of the proposed algorithms are demonstrated on a variety of problems including homogeneous polynomial optimization, computation of stability number, and 3D structure determination from Common Lines in Cryo-EM.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。