arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.18879cs.LGmath.STstat.MLstat.TH
收藏

通过仿射簇维度理解物理信息模型中的泛化能力

Understanding Generalization in Physics Informed Models through Affine Variety Dimensions

Takeshi Koshizuka, Issei Sato

AI总结:

针对现有物理信息机器学习理论局限于非混合设置和线性系统的问题,提出统一残差形式以纳入不完整物理约束,并证明模型泛化性能由物理约束相关的仿射簇维度而非参数数量决定,适用于线性和非线性方程。

摘要:

物理信息机器学习正因通过整合物理知识来提升统计性能和样本效率而获得显著关注。然而,当前的理论分析通常假设非混合设置下具备完整的先验知识,忽视了观测数据的关键整合,且常常局限于线性系统,这与许多实际应用中普遍存在的非线性特性不符。为了解决这些局限性,我们引入了一种统一的残差形式,将配点法和变分方法统一起来,从而能够在混合学习设置中纳入不完整且复杂的物理约束。在此公式化框架内,我们证明了此类混合设置下物理信息回归的泛化性能由与物理约束相关的仿射簇的维度决定,而非由参数数量决定。这使得进行适用于线性和非线性方程的统一分析成为可能。我们还提出了一种近似该维度的方法,并对我们的理论发现提供了实验验证。

英文摘要:

Physics-informed machine learning is gaining significant traction for enhancing statistical performance and sample efficiency through the integration of physical knowledge. However, current theoretical analyses often presume complete prior knowledge in non-hybrid settings, overlooking the crucial integration of observational data, and are frequently limited to linear systems, unlike the prevalent nonlinear nature of many real-world applications. To address these limitations, we introduce a unified residual form that unifies collocation and variational methods, enabling the incorporation of incomplete and complex physical constraints in hybrid learning settings. Within this formulation, we establish that the generalization performance of physics-informed regression in such hybrid settings is governed by the dimension of the affine variety associated with the physical constraint, rather than by the number of parameters. This enables a unified analysis that is applicable to both linear and nonlinear equations. We also present a method to approximate this dimension and provide experimental validation of our theoretical findings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑