arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1402.5284math.OCcs.LGcs.NAmath.NA
收藏

关于通过Łojasiewicz不等式在低秩矩阵流形上投影线搜索方法收敛性的结果

Convergence results for projected line-search methods on varieties of low-rank matrices via Łojasiewicz inequality

University of Bonn(波恩大学)

Reinhold Schneider, André Uschmajew

AI总结:

本文利用Łojasiewicz不等式研究了在低秩矩阵流形上投影线搜索方法的收敛性,分析了其在闭合性和曲率无界性方面的优势,并给出了临界点位于流形光滑部分的理论依据。

摘要:

本文旨在推导在实代数流形$\mathcal{M}_{\le k}$上投影线搜索方法的收敛性结果,该流形由实$m \times n$矩阵构成,其秩至多为$k$。此类方法扩展了用于光滑流形$\mathcal{M}_k$上的黎曼优化方法,通过在切锥中沿梯度相关方向取步长,然后投影回$\mathcal{M}_{\le k}$。考虑此类方法可避免$\mathcal{M}_k$的非闭合性和无界曲率带来的困难。基于实解析函数的点收敛性,利用投影反梯度到切锥的Łojasiewicz不等式获得收敛性结果。如果极限点位于$\mathcal{M}_{\le k}$的光滑部分,即$\mathcal{M}_k$中,则结果退化为已知结果,但能通过极限点在光滑流形上获得渐近收敛速率估计,无需先验曲率界。同时,可以给出假设临界点位于$\mathcal{M}_k$的理论依据:若$X$是$f$在$\mathcal{M}_{\le k}$上的临界点,则$X$的秩为$k$或$\nabla f(X) = 0$。

英文摘要:

The aim of this paper is to derive convergence results for projected line-search methods on the real-algebraic variety $\mathcal{M}_{\le k}$ of real $m \times n$ matrices of rank at most $k$. Such methods extend Riemannian optimization methods, which are successfully used on the smooth manifold $\mathcal{M}_k$ of rank-$k$ matrices, to its closure by taking steps along gradient-related directions in the tangent cone, and afterwards projecting back to $\mathcal{M}_{\le k}$. Considering such a method circumvents the difficulties which arise from the nonclosedness and the unbounded curvature of $\mathcal{M}_k$. The pointwise convergence is obtained for real-analytic functions on the basis of a Łojasiewicz inequality for the projection of the antigradient to the tangent cone. If the derived limit point lies on the smooth part of $\mathcal{M}_{\le k}$, i.e. in $\mathcal{M}_k$, this boils down to more or less known results, but with the benefit that asymptotic convergence rate estimates (for specific step-sizes) can be obtained without an a priori curvature bound, simply from the fact that the limit lies on a smooth manifold. At the same time, one can give a convincing justification for assuming critical points to lie in $\mathcal{M}_k$: if $X$ is a critical point of $f$ on $\mathcal{M}_{\le k}$, then either $X$ has rank $k$, or $\nabla f(X) = 0$.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑