arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.23977cs.LGcs.AI
收藏

电路启发的具有统一神经动力学建模的高阶神经网络用于PDE求解与视觉感知

Circuit-Inspired High-Order Neural Networks with Unified Neural Dynamics Modeling for PDE Solving and Visual Perception

Communication University of China(通信大学);AI Research, Qihoo 360(360人工智能研究院,奇虎360);Eastern Institute of Technology, Ningbo(宁波工程技术院)

Tongfei Chen, Jingying Yang, Linlin Yang, Juan Zhang, Jinhu Lü, David Doermann, Chunyu Xie, Long He, Tian Wang, Guodong Guo, Baochang Zhang

AI总结:

提出电路启发的高阶神经网络(CHONN),通过基尔霍夫级联组合实现高阶动力学算子,在PDE求解、长期物理预测和ImageNet-1K识别中提升结构保真度和稳定性。

摘要:

深度网络通常依赖架构启发式方法来塑造表示演化,限制了其对由内在动力学支配的数据的建模能力。我们提出了电路启发的高阶神经网络(CHONN),这是一个模块化框架,将表示演化视为一个潜在势过程,并通过基尔霍夫启发的级联组合增加其有效阶数。单个基尔霍夫神经单元实现稳定的一阶更新,而串行组合的单元在一个块内形成高阶动力学算子。这种构造是可解释的、数值稳定的,并且与常见的神经骨干网络兼容。理论分析表明,级联单元诱导出端到端的高阶算子,控制实验证明块内高阶构造不同于通用深度堆叠,特别是在导数敏感度量上。在稳态算子学习、长期物理预测和ImageNet-1K识别中,CHONN提高了结构保真度、滚动稳定性和视觉表示学习。这些结果将高阶电路组合确定为神经动力学建模的一般原则。

英文摘要:

Deep networks often rely on architectural heuristics to shape representation evolution, limiting their ability to model data governed by intrinsic dynamics. We present the Circuit-inspired High-Order Neural Network (CHONN), a modular framework that treats representation evolution as a latent potential process and increases its effective order through Kirchhoff-inspired cascade composition. A single Kirchhoff Neural Cell implements a stable first-order update, while serially composed cells form higher-order dynamical operators within one block. This construction is interpretable, numerically stable and compatible with common neural backbones. Theoretical analysis shows that cascaded cells induce end-to-end high-order operators, and controlled experiments demonstrate that intra-block high-order construction differs from generic depth stacking, especially on derivative-sensitive measures. Across steady-state operator learning, long-horizon physical forecasting and ImageNet-1K recognition, CHONN improves structural fidelity, rollout stability and visual representation learning. These results identify high-order circuit composition as a general principle for neural dynamics modeling.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑