arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.01206math.OC
收藏

动态不精确预言机的梯度法

Gradient Methods with Dynamic Inexact Oracles

Shuo Han

摘要:

我们表明,原始-对偶梯度法,也被称为梯度下降上升法,解决凸-凹极大极小问题,可以被视为一个不精确的梯度法适用于原始问题。梯度的精确计算依赖于求解内部最大化问题,通过另一种梯度法近似计算。为了模拟由迭代算法实现的近似计算例程,我们引入了动态不精确预言机的概念,这是离散时间动力系统,其输出渐近接近精确预言机的输出。我们提出了一个统一的收敛性分析一般的一阶方法实现的动态不精确预言机,并证明其使用在创建新的加速原始对偶法。

英文摘要:

We show that the primal-dual gradient method, also known as the gradient descent ascent method, for solving convex-concave minimax problems can be viewed as an inexact gradient method applied to the primal problem. The gradient, whose exact computation relies on solving the inner maximization problem, is computed approximately by another gradient method. To model the approximate computational routine implemented by iterative algorithms, we introduce the notion of dynamic inexact oracles, which are discrete-time dynamical systems whose output asymptotically approaches the output of an exact oracle. We present a unified convergence analysis for dynamic inexact oracles realized by general first-order methods and demonstrate its use in creating new accelerated primal-dual algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑