arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2107.08166math.OCcs.LG
收藏

数据通知深度Optimization

Data-informed Deep Optimization

Shanghai Jiao Tong University(上海交通大学);Shanghai Center for Brain Science and Brain-Inspired Technology(上海脑科学与类脑研究中心)

Lulu Zhang, Zhi-Qin John Xu, Yaoyu Zhang

摘要:

复杂的设计问题在科学和工业领域中很常见。在实践中,这些问题的目标函数或约束条件往往没有明确的公式,只能通过实验或仿真在一组采样点上进行估计。这种最优化问题是特别具有挑战性的设计参数时,由于维数灾难是高维的。在这项工作中,我们提出了一种基于数据的深度优化(DiDo)方法:首先,我们使用深度神经网络(DNN)分类器来学习可行域;其次,我们基于DNN分类器对可行点进行采样,以拟合目标函数;最后,我们通过梯度下降找到DNN代理最优化问题的最优点。为了证明我们的DiDo方法的有效性,我们考虑了一个实际的设计案例,在工业中,我们的方法使用有限大小的训练数据产生良好的解决方案。我们进一步使用一个100维的玩具的例子来显示我们的模型的有效性,更高维的问题。我们的研究结果表明,由DNN授权的DiDo方法是灵活的,并有希望在实践中解决一般的高维设计问题。

英文摘要:

Complex design problems are common in the scientific and industrial fields. In practice, objective functions or constraints of these problems often do not have explicit formulas, and can be estimated only at a set of sampling points through experiments or simulations. Such optimization problems are especially challenging when design parameters are high-dimensional due to the curse of dimensionality. In this work, we propose a data-informed deep optimization (DiDo) approach as follows: first, we use a deep neural network (DNN) classifier to learn the feasible region; second, we sample feasible points based on the DNN classifier for fitting of the objective function; finally, we find optimal points of the DNN-surrogate optimization problem by gradient descent. To demonstrate the effectiveness of our DiDo approach, we consider a practical design case in industry, in which our approach yields good solutions using limited size of training data. We further use a 100-dimension toy example to show the effectiveness of our model for higher dimensional problems. Our results indicate that the DiDo approach empowered by DNN is flexible and promising for solving general high-dimensional design problems in practice.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑