arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1703.01670eess.SYcs.SYmath.OC
收藏

一阶优化方法的控制解释

Control Interpretations for First-Order Optimization Methods

Bin Hu, Laurent Lessard

AI总结:

本文通过控制理论解释一阶优化方法,揭示其与PID控制器和滞后补偿器的关联,并利用小增益定理连接优化收敛率与互补灵敏度函数的输入输出增益计算。

摘要:

一阶迭代优化方法在大规模优化和机器学习中起着基础性作用。本文提出了这些优化方法的控制解释。首先,我们为几种现有优化方法提供闭环形状解释,并展示它们由PID和滞后补偿器等基本控制元件组成。其次,我们应用小增益定理,建立优化方法收敛率分析与某些互补灵敏度函数的输入输出增益计算之间的联系。这些联系表明,标准的经典控制合成工具可能可用于优化算法的设计。

英文摘要:

First-order iterative optimization methods play a fundamental role in large scale optimization and machine learning. This paper presents control interpretations for such optimization methods. First, we give loop-shaping interpretations for several existing optimization methods and show that they are composed of basic control elements such as PID and lag compensators. Next, we apply the small gain theorem to draw a connection between the convergence rate analysis of optimization methods and the input-output gain computations of certain complementary sensitivity functions. These connections suggest that standard classical control synthesis tools may be brought to bear on the design of optimization algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑