arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2301.07102cs.LGmath.OC
收藏

关于在深度学习问题中使用深度学习代理作为前向模型

On Using Deep Learning Proxies as Forward Models in Deep Learning Problems

AIQ;MBZUAI(穆罕默德·本·扎耶德人工智能大学)

Fatima Albreiki, Nidhal Belayouni, Deepak K. Gupta

摘要:

基于物理的优化问题通常非常耗时,特别是由于与正演模型相关联的计算复杂性。最近的工作表明,物理建模可以近似与神经网络。然而,总是有一定程度的错误与这种学习,我们在本文中研究这方面。我们证明,通过流行的数学基准实验,这些功能的神经网络近似(NN代理)时,插入到优化框架,可能会导致错误的结果。特别是,我们研究了粒子群优化和遗传算法方法的行为,并分析了它们的稳定性时,再加上神经网络代理。近似模型的正确性取决于在参数空间中进行采样的程度,并通过数值实验,我们证明,需要谨慎时,构造这个景观与神经网络。此外,NN代理很难训练高维函数,我们提出了我们的见解4D和10D的问题。在这种情况下,误差较高,我们证明了它是敏感的抽样方案的选择,用于建立NN代理。该代码可在https://github.com/Fa-ti-ma/NN-proxy-in-optimization上获得。

英文摘要:

Physics-based optimization problems are generally very time-consuming, especially due to the computational complexity associated with the forward model. Recent works have demonstrated that physics-modelling can be approximated with neural networks. However, there is always a certain degree of error associated with this learning, and we study this aspect in this paper. We demonstrate through experiments on popular mathematical benchmarks, that neural network approximations (NN-proxies) of such functions when plugged into the optimization framework, can lead to erroneous results. In particular, we study the behavior of particle swarm optimization and genetic algorithm methods and analyze their stability when coupled with NN-proxies. The correctness of the approximate model depends on the extent of sampling conducted in the parameter space, and through numerical experiments, we demonstrate that caution needs to be taken when constructing this landscape with neural networks. Further, the NN-proxies are hard to train for higher dimensional functions, and we present our insights for 4D and 10D problems. The error is higher for such cases, and we demonstrate that it is sensitive to the choice of the sampling scheme used to build the NN-proxy. The code is available at https://github.com/Fa-ti-ma/NN-proxy-in-optimization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑