Complex design problems are common in the scientific and industrial fields. In practice, objective functions or constraints of these problems often do not have explicit formulas, and can be estimated only at a set of sampling points through experiments or simulations. Such optimization problems are especially challenging when design parameters are high-dimensional due to the curse of dimensionality. In this work, we propose a data-informed deep optimization (DiDo) approach as follows: first, we use a deep neural network (DNN) classifier to learn the feasible region; second, we sample feasible points based on the DNN classifier for fitting of the objective function; finally, we find optimal points of the DNN-surrogate optimization problem by gradient descent. To demonstrate the effectiveness of our DiDo approach, we consider a practical design case in industry, in which our approach yields good solutions using limited size of training data. We further use a 100-dimension toy example to show the effectiveness of our model for higher dimensional problems. Our results indicate that the DiDo approach empowered by DNN is flexible and promising for solving general high-dimensional design problems in practice.
Optimization with learning-informed differential equation constraints and its applications
Institute for Mathematics, Humboldt University of Berlin(柏林洪堡大学数学研究所);Weierstrass Institute for Applied Analysis and Stochastics (WIAS)(魏尔斯特拉斯应用分析与随机研究所)
Gradient-Informed Bayesian and Interior Point Optimization for Efficient Inverse Design in Nanophotonics
Institute of Information Processing, Leibniz University Hannover(莱比锡洪堡大学信息处理研究所);Flexcompute, Watertown, MA, USA(Flexcompute公司);Institute of Artificial Intelligence, Leibniz University Hannover(莱比锡洪堡大学人工智能研究所);L3S Research Center, Hannover, Germany(L3S研究中心)
A Block-Coordinate Approach of Multi-level Optimization with an Application to Physics-Informed Neural Networks
Université de Toulouse(图卢兹大学);INP-ENSEEIHT(国立图卢兹应用科学学院-国立高等电子、电工、计算机、水力与电信学院);IRIT(图卢兹计算机研究所);CERFACS(欧洲科学计算高级研究中心);BRLi(BRLi公司);Université de Lyon(里昂大学);INRIA(法国国家信息与自动化研究所);ENSL(里昂高等师范学院);UCBL(里昂第一大学);CNRS(法国国家科学研究中心);University of Namur(那慕尔大学)
Curvature-Aware Optimization for High-Accuracy Physics-Informed Neural Networks
Department of Information Engineering and Computer Science, University of Trento(特伦托大学信息工程与计算机科学系);Division of Applied Mathematics, Brown University(布朗大学应用数学部);Center for Biomedical Engineering, Brown University(布朗大学生物医学工程中心);Institute of Mathematics, TU Berlin(柏林工业大学数学研究所);ETH Zurich(苏黎世联邦理工学院)