arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.09101cs.LGcs.NAmath.DSmath.NAmath.OC
收藏

从Adam到Adam-like拉格朗日量:二阶非局部动力学

From Adam to Adam-Like Lagrangians: Second-Order Nonlocal Dynamics

IAMM Research, Department of Applied Artificial Intelligence(IAMM研究机构、应用人工智能系)

Carlos Heredia

AI总结:

本文提出了一种基于非局部拉格朗日量的二阶连续时间Adam动力学模型,并通过数值实验验证了其与离散Adam的一致性。

摘要:

在本文中,我们通过将Adam建模为一个二阶积分微分动力系统,推导出一种加速的连续时间公式。我们将这种惯性非局部模型通过α-细化极限与现有的第一阶非局部Adam流相关联,并提供了基于Lyapunov的稳定性与收敛性分析。我们还引入了受Adam启发的非局部拉格朗日公式,提供了变分观点。在Rosenbrock型示例上的数值模拟显示,所提出动力学与离散Adam之间存在一致性和吻合。

英文摘要:

In this paper, we derive an accelerated continuous-time formulation of Adam by modeling it as a second-order integro-differential dynamical system. We relate this inertial nonlocal model to an existing first-order nonlocal Adam flow through an $α$-refinement limit, and we provide Lyapunov-based stability and convergence analyses. We also introduce an Adam-inspired nonlocal Lagrangian formulation, offering a variational viewpoint. Numerical simulations on Rosenbrock-type examples show agreement between the proposed dynamics and discrete Adam.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑