In this paper, we illustrate a novel method for solving optimization problems when derivatives are not explicitly available. We show that combining implicit filtering (IF), an existing derivative free optimization (DFO) method, with a deep neural network global approximator leads to an accelerated DFO method. Derivative free optimization problems occur in a wide variety of applications, including simulation based optimization and the optimization of stochastic processes, and naturally arise when the objective function can be viewed as a black box, such as a computer simulation. We highlight the practical value of our method, which we call deep neural network accelerated implicit filtering (DNNAIF), by demonstrating its ability to help solve the coverage directed generation (CDG) problem. Solving the CDG problem is a key part of the design and verification process for new electronic circuits, including the chips that power modern servers and smartphones.
Implicit Regularization of Accelerated Methods in Hilbert Spaces
Università degli Studi di Genova(热那亚大学);Machine Learning Genoa Center(热那亚机器学习中心);Massachusetts Institute of Technology(麻省理工学院);Istituto Italiano di Tecnologia(意大利技术研究院)
Accelerated Implicit GDA Schemes: Theoretical Guarantees and Application to Proximal Augmented Lagrangian Methods
Shanghai Institute for Mathematics and Interdisciplinary Sciences (SIMIS)(上海数学与交叉学科研究院);Research Institute of Intelligent Complex Systems, Fudan University(复旦大学智能复杂系统研究所);Center for Mathematics and Interdisciplinary Sciences, Fudan University(复旦大学数学与交叉学科中心)
Convergence analysis of accelerated algorithms via a mixed-order dynamical system for separable nonsmooth convex optimization
Chongqing Key Laboratory of Statistical Intelligent Computing and Monitoring, School of Mathematics and Statistics, Chongqing Technology and Business University(重庆工商大学数学与统计学院,统计智能计算与监测重庆市重点实验室)
An accelerated primal-dual flow for linearly constrained multiobjective optimization
National Center for Applied Mathematics in Chongqing, Chongqing Normal University(重庆师范大学 重庆应用数学中心);School of Mathematical Sciences, Chongqing Normal University(重庆师范大学 数学科学学院);Chongqing Research Institute of Big Data, Peking University(北京大学 重庆大数据研究院)