arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2601.12971cs.LG
收藏

通过注意力表示和冲突解决梯度进行物理信息神经网络的架构优化协同设计

Architecture--Optimization Co-Design for Physics-Informed Neural Networks via Layer-wise Coordinate Adaptation and Gradient Conflict Resolution

College of Applied Mathematics(应用数学学院);Chengdu University of Information Technology(成都信息科技大學);College of Mathematics(数学学院);Sichuan University(四川大学);School of Sciences(科学学院)

Pancheng Niu, Jun Guo, Qiaolin He, Yongming Chen, Yanchao Shi

AI总结:

本文提出ACR-PINN,通过注意力表示和冲突解决梯度优化,提升PINN在求解PDEs时的鲁棒性和精度。

摘要:

物理信息神经网络(PINNs)提供了一种基于学习的框架,通过将支配物理定律嵌入到神经网络训练中来解决偏微分方程(PDEs)。然而,在实践中,其性能常常受到有限的表示能力以及由竞争的物理约束和冲突的梯度引起的优化困难的限制。在本工作中,我们从统一的架构-优化视角研究PINN训练。我们首先提出了一种分层动态注意力机制,以增强表示灵活性,从而得到分层动态注意力PINN(LDA-PINN)。然后我们将PINN训练重新表述为一个多任务学习问题,并引入一种冲突解决的梯度更新策略以缓解梯度干扰,从而得到梯度冲突解决PINN(GC-PINN)。通过整合这两个组件,我们开发了架构冲突解决PINN(ACR-PINN),它结合了注意力表示和冲突意识的优化,同时保持标准PINN损失公式。在基准PDEs上的广泛实验,包括Burgers、Helmholtz、Klein-Gordon和驱动腔流问题,表明ACR-PINN在收敛速度和相对L2和L∞误差方面均优于标准PINNs。这些结果突显了架构-优化协同设计在提高PINN求解器鲁棒性和准确性方面的有效性。

英文摘要:

Physics-informed neural networks (PINNs) can be limited by coordinate representations and conflicting gradients from heterogeneous physical constraints. We propose Architecture--Conflict-Resolved PINN (ACR-PINN), combining Layer-wise Dynamic Adaptation (LDA) and Gradient-Conflict-Resolved PINN (GCR-PINN). LDA constructs layer-specific coordinate features and fuses two encoding branches through input-conditioned, feature-wise gates. GCR-PINN treats PDE, initial-condition, and boundary-condition losses as separate tasks and conditionally projects negatively aligned gradients before aggregation, without changing the physical loss formulation. Across seven benchmark problems, ACR-PINN achieves the lowest observed mean across all metrics among four core architecture--optimizer combinations, reducing mean relative $L_2$ error by approximately 56--97\% relative to Std-PINN and improving on the better single-component variant. Capacity-controlled comparisons and gate interventions indicate that these gains reflect the learned coordinate-fusion pathway rather than parameter count alone. Gradient diagnostics suggest that LDA can improve task-gradient compatibility and reduce the correction required by GCR-PINN, with effects depending on the problem and update rule. Comparisons with representative PINN baselines and tests over sampling and temporal-horizon changes support the observed accuracy gains within the studied settings, while equal-time experiments reveal an accuracy--cost trade-off from the richer LDA representation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑