arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.04104cs.LG
收藏

教网络解决最优化问题

Teaching Networks to Solve Optimization Problems

Vanderbilt University(范德堡大学);University of Texas at Austin(德克萨斯大学奥斯汀分校)

Xinran Liu, Yuzhe Lu, Ali Abbasi, Meiyi Li, Javad Mohammadi, Soheil Kolouri

摘要:

利用机器学习来促进优化过程是一个新兴的领域,它有望绕过在需要近实时优化的关键应用中由经典迭代求解器引起的基本计算瓶颈。大多数现有的方法都专注于学习数据驱动的优化器,这些优化器在解决优化问题时会导致更少的迭代。在本文中,我们采取了不同的方法,并建议用一个可训练的参数集函数来代替迭代求解器,该函数在单个前馈中输出优化问题的最佳参数/参数。我们将我们的方法称为学习优化优化过程(LOOP)。我们展示了学习这些参数(集)函数来解决各种经典优化问题的可行性,包括线性/非线性回归,主成分分析,基于运输的coreset和供应管理应用中的二次规划。此外,我们提出了两种替代方法来学习这样的参数函数,在循环中有和没有求解器。最后,通过各种数值实验,我们表明,经过训练的求解器可以比经典的迭代求解器快几个数量级,同时提供接近最优的解决方案。

英文摘要:

Leveraging machine learning to facilitate the optimization process is an emerging field that holds the promise to bypass the fundamental computational bottleneck caused by classic iterative solvers in critical applications requiring near-real-time optimization. The majority of existing approaches focus on learning data-driven optimizers that lead to fewer iterations in solving an optimization. In this paper, we take a different approach and propose to replace the iterative solvers altogether with a trainable parametric set function, that outputs the optimal arguments/parameters of an optimization problem in a single feed forward. We denote our method as Learning to Optimize the Optimization Process (LOOP). We show the feasibility of learning such parametric (set) functions to solve various classic optimization problems including linear/nonlinear regression, principal component analysis, transport-based coreset, and quadratic programming in supply management applications. In addition, we propose two alternative approaches for learning such parametric functions, with and without a solver in the LOOP. Finally, through various numerical experiments, we show that the trained solvers could be orders of magnitude faster than the classic iterative solvers while providing near optimal solutions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑