arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.13246math.OC
收藏

PDFO:面向Powell无导数优化求解器的跨平台包

PDFO: A Cross-Platform Package for Powell's Derivative-Free Optimization Solvers

Tom M. Ragonneau, Zaikun Zhang

AI总结:

针对Powell的五种Fortran 77无导数优化求解器使用不便的问题,本文推出跨平台包PDFO,提供Python和MATLAB易用接口并修复改进,同时梳理方法特性、通过实验验证其稳定性与超参数优化潜力。

摘要:

已故的M. J. D. Powell教授提出了五种用于无导数优化的信赖域方法,分别是COBYLA、UOBYQA、NEWUOA、BOBYQA和LINCOA。他将这些方法精心实现为公开可用的求解器,以鲁棒性和高效性著称。但这些求解器采用Fortran 77编写,部分用户可能难以直接使用。我们推出PDFO包,为Powell的代码提供易用的Python和MATLAB接口。借助PDFO,使用这些语言的用户无需处理Fortran代码即可便捷调用Powell的Fortran求解器。此外,PDFO包含错误修复与改进,对处理存在病态问题或函数求值失败的问题尤为重要。除PDFO包外,我们还概述了Powell的方法,从统一视角对其进行梳理,总结主要特性,并点明各方法间的相似性与内在关联。我们还开展了针对PDFO的实验,验证了其在噪声下的稳定性、对函数求值失败的容错能力,以及求解特定超参数优化问题的潜力。

英文摘要:

The late Professor M. J. D. Powell devised five trust-region methods for derivative-free optimization, namely COBYLA, UOBYQA, NEWUOA, BOBYQA, and LINCOA. He carefully implemented them into publicly available solvers, renowned for their robustness and efficiency. However, the solvers were implemented in Fortran 77 and hence may not be easily accessible to some users. We introduce the PDFO package, which provides user-friendly Python and MATLAB interfaces to Powell's code. With PDFO, users of such languages can call Powell's Fortran solvers easily without dealing with the Fortran code. Moreover, PDFO includes bug fixes and improvements, which are particularly important for handling problems that suffer from ill-conditioning or failures of function evaluations. In addition to the PDFO package, we provide an overview of Powell's methods, sketching them from a uniform perspective, summarizing their main features, and highlighting the similarities and interconnections among them. We also present experiments on PDFO to demonstrate its stability under noise, tolerance of failures in function evaluations, and potential to solve certain hyperparameter optimization problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑