探索线性求解器算法在现代非线性最优化应用中的优势
Exploring Benefits of Linear Solver Parallelism on Modern Nonlinear Optimization Applications
摘要:
高效的内点最优化方法的出现使得大规模线性和非线性规划(NLP)问题的求解变得容易。这种方法的一个突出例子是Ipopt,一个广泛使用的开源非线性最优化求解器。从数学上讲,Ipopt依赖于使用稀疏对称不定线性系求解器,这是大量采用的障碍子问题的优化。因此,Ipopt的性能和可靠性取决于所选线性求解器的属性。受数学规划解决更大,更具有挑战性的NLP的趋势的启发,这项工作探讨了两个核心问题:第一,如何可用的线性求解器的可扩展性,其中许多表现出共享内存并行性,影响Ipopt的性能;第二,最好的线性求解器在NLP问题类,包括非线性网络问题和偏微分方程约束的问题之间是否存在差异?为了更好地理解这些属性,本文首先介绍了现有的开源和闭源,串行和并行线性求解器和它们之间的根本区别。其次,它介绍了一种新的开源线性求解器的耦合,能够异构并行多核中央处理单元和图形处理单元。第三,它比较线性求解器使用各种数学规划问题,包括线性和非线性最优化的标准测试问题,最优潮流基准,可扩展的二维和三维偏微分方程和最优控制问题。最后,提供了线性求解器建议,以最大限度地提高不同应用程序域的Ipopt性能。
英文摘要:
The advent of efficient interior point optimization methods has enabled the tractable solution of large-scale linear and nonlinear programming (NLP) problems. A prominent example of such a method is seen in Ipopt, a widely-used, open-source nonlinear optimization solver. Algorithmically, Ipopt depends on the use of a sparse symmetric indefinite linear system solver, which is heavily employed within the optimization of barrier subproblems. As such, the performance and reliability of Ipopt is dependent on the properties of the selected linear solver. Inspired by a trend in mathematical programming toward solving larger and more challenging NLPs, this work explores two core questions: first, how does the scalability of available linear solvers, many of which exhibit shared-memory parallelism, impact Ipopt performance; and second, does the best linear solver vary across NLP problem classes, including nonlinear network problems and problems constrained by partial differential equations? To better understand these properties, this paper first describes available open- and closed-source, serial and parallel linear solvers and the fundamental differences among them. Second, it introduces the coupling of a new open-source linear solver capable of heterogeneous parallelism over multi-core central processing units and graphics processing units. Third, it compares linear solvers using a variety of mathematical programming problems, including standard test problems for linear and nonlinear optimization, optimal power flow benchmarks, and scalable two- and three-dimensional partial differential equation and optimal control problems. Finally, linear solver recommendations are provided to maximize Ipopt performance across different application domains.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。