arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.10159cs.LGmath.OCstat.ML
收藏

一种基于拉格朗日对偶的理论引导的深度神经网络

A Lagrangian Dual-based Theory-guided Deep Neural Network

PengCheng Laboratory(鹏城实验室);Southern University of Science and Technology(南方科技大学);Peking University(北京大学)

Miao Rong, Dongxiao Zhang, Nanzhe Wang

摘要:

理论引导神经网络(Theory-guided Neural Network,TgNN)是一种通过引入科学知识或物理信息来提高神经网络结构有效性和效率的方法。尽管取得了巨大的成功,但理论引导的(深度)神经网络在训练过程中保持训练数据和领域知识之间的权衡时具有一定的局限性。本文提出了一种基于拉格朗日对偶的TgNN(TgNN-LD)来提高TgNN的有效性。我们将原来的损失函数转换成一个约束形式的项目较少,其中偏微分方程(PDE),工程控制(EC),专家知识(EK)被视为约束,每个约束一个拉格朗日变量。这些拉格朗日变量被纳入观测数据和相应的约束条件之间实现公平的权衡,以提高预测精度,并节省时间和计算资源调整的ad-hoc程序。为了研究所提出的方法的性能,原来的TgNN模型与一组优化的权重值调整ad-hoc程序进行了比较,地下水流问题,与他们的L2误差,R平方(R2),和计算时间进行了分析。实验结果证明了拉格朗日对偶TgNN的优越性。

英文摘要:

The theory-guided neural network (TgNN) is a kind of method which improves the effectiveness and efficiency of neural network architectures by incorporating scientific knowledge or physical information. Despite its great success, the theory-guided (deep) neural network possesses certain limits when maintaining a tradeoff between training data and domain knowledge during the training process. In this paper, the Lagrangian dual-based TgNN (TgNN-LD) is proposed to improve the effectiveness of TgNN. We convert the original loss function into a constrained form with fewer items, in which partial differential equations (PDEs), engineering controls (ECs), and expert knowledge (EK) are regarded as constraints, with one Lagrangian variable per constraint. These Lagrangian variables are incorporated to achieve an equitable tradeoff between observation data and corresponding constraints, in order to improve prediction accuracy, and conserve time and computational resources adjusted by an ad-hoc procedure. To investigate the performance of the proposed method, the original TgNN model with a set of optimized weight values adjusted by ad-hoc procedures is compared on a subsurface flow problem, with their L2 error, R square (R2), and computational time being analyzed. Experimental results demonstrate the superiority of the Lagrangian dual-based TgNN.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑