arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.03572cs.LGcs.NAmath.NA
收藏

残差多保真度神经网络计算

Residual Multi-Fidelity Neural Network Computing

University of New Mexico(新墨西哥大学);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);RWTH Aachen University(亚琛工业大学)

Owen Davis, Mohammad Motamed, Raul Tempone

AI总结:

本文研究多保真度神经网络代理模型构建问题,提出基于ReLU网络误差复杂度估计的非线性残差框架,通过训练两个协同网络学习残差并生成合成高保真数据,显著降低了小容差预测下的计算成本。

摘要:

在这项工作中,我们考虑了使用多保真度信息构建神经网络代理模型的一般问题。受 ReLU 神经网络的误差复杂度估计的启发,我们将廉价的低保真度模型与昂贵的高保真度模型之间的相关性表述为一个可能的非线性残差函数。该函数定义了以下两者之间的映射:1)模型的共享输入空间以及低保真度模型输出,2)两个模型输出之间的差异。计算框架通过训练两个神经网络协同工作来进行。第一个网络在少量高保真度和低保真度数据上学习残差函数。一旦训练完成,该网络用于生成额外的合成高保真度数据,这些数据用于第二个网络的训练。训练好的第二个网络随后作为我们感兴趣的高保真度量的代理。我们给出了四个数值例子来展示所提框架的强大能力,表明当期望输出预测在较小容差内准确时,可以实现计算成本的显著节省。

英文摘要:

In this work, we consider the general problem of constructing a neural network surrogate model using multi-fidelity information. Motivated by error-complexity estimates for ReLU neural networks, we formulate the correlation between an inexpensive low-fidelity model and an expensive high-fidelity model as a possibly non-linear residual function. This function defines a mapping between 1) the shared input space of the models along with the low-fidelity model output, and 2) the discrepancy between the outputs of the two models. The computational framework proceeds by training two neural networks to work in concert. The first network learns the residual function on a small set of high- and low-fidelity data. Once trained, this network is used to generate additional synthetic high-fidelity data, which is used in the training of the second network. The trained second network then acts as our surrogate for the high-fidelity quantity of interest. We present four numerical examples to demonstrate the power of the proposed framework, showing that significant savings in computational cost may be achieved when the output predictions are desired to be accurate within small tolerances.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑