arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.03062math.OC
收藏

基于三阶时发展方程的快速凸优化算法:TOGES-V--改进的TOGES

Fast convex optimization via a third-order in time evolution equation: TOGES-V an improved version of TOGES

Hedy Attouch, Zaki Chbani, Hassan Riahi

摘要:

在Hilbert空间中,对于凸优化,我们分析了三阶时间演化系统生成的轨迹在t趋于无穷大时的快速收敛性.要最小化的函数f应该是凸的、连续可微的,并且具有非空的最小值集。它通过梯度进入动态。基于这个新的动力系统,我们改进了[Attouch,Chbani,Riahi:Fast凸优化via a third order in time发展方程,Optimization 2020]中的结果。作为主要结果,当阻尼参数$α$满足$α> 3$时,我们证明了当t趋于无穷大时,阻尼参数$α$的值在1/t3阶收敛,以及轨迹的收敛.我们补充这些结果引入到动态的海森驱动的阻尼项,减少了振荡。在强凸函数f的情况下,我们证明了一个三阶自治演化系统的指数收敛速率。所有这些结果都对具有扩张实值的凸下连续函数的情形有自然扩张。把f换成它的莫罗信封。

英文摘要:

In a Hilbert space setting H, for convex optimization, we analyze the fast convergence properties as t tends to infinity of the trajectories generated by a third-order in time evolution system. The function f to minimize is supposed to be convex, continuously differentiable, with a nonempty set of minimizers. It enters into the dynamic through its gradient. Based on this new dynamical system, we improve the results obtained by [Attouch, Chbani, Riahi: Fast convex optimization via a third-order in time evolution equation, Optimization 2020]. As a main result, when the damping parameter $α$ satisfies $α> 3$, we show that the convergence of the values at the order 1/t3 as t goes to infinity, as well as the convergence of the trajectories. We complement these results by introducing into the dynamic an Hessian driven damping term, which reduces the oscillations. In the case of a strongly convex function f, we show an autonomous evolution system of the third order in time with an exponential rate of convergence. All these results have natural extensions to the case of a convex lower semicontinuous function with extended real values. Just replace f with its Moreau envelope.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑