arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1901.10416cond-mat.dis-nncond-mat.stat-mech
收藏

神经网络的统计场论

Statistical field theory for neural networks

Moritz Helias, David Dahmen

摘要:

这些笔记试图一个独立的介绍到统计场论适用于神经网络的速率单位和二进制自旋。介绍由三个部分组成:第一,介绍基本概念的概率,矩,累积量,以及它们之间的关系的连锁集群定理,其中威克定理是最重要的特殊情况;其次是图解制定的扰动理论,审查统计设置。第二,伊藤公式中的随机微分方程描述的动态,在Martin-Siggia-Rose-De Dominicis-Janssen路径积分形式主义中处理。从无序系统的概念,然后,我们研究网络的随机连接,并推导出自洽的动态平均场论,解释统计的波动和出现不同的阶段与规则和混沌动力学。第三,我们介绍了有效作用量,顶点函数,和循环展开。这些工具说明了系统的自洽方程的推导,超越平均场近似。这些方法适用于成对最大熵(伊辛自旋)模型,包括最近发现的图形推导Thouless-Anderson-Palmer平均场论。

英文摘要:

These notes attempt a self-contained introduction into statistical field theory applied to neural networks of rate units and binary spins. The presentation consists of three parts: First, the introduction of fundamental notions of probabilities, moments, cumulants, and their relation by the linked cluster theorem, of which Wick's theorem is the most important special case; followed by the diagrammatic formulation of perturbation theory, reviewed in the statistical setting. Second, dynamics described by stochastic differential equations in the Ito-formulation, treated in the Martin-Siggia-Rose-De Dominicis-Janssen path integral formalism. With concepts from disordered systems, we then study networks with random connectivity and derive their self-consistent dynamic mean-field theory, explaining the statistics of fluctuations and the emergence of different phases with regular and chaotic dynamics. Third, we introduce the effective action, vertex functions, and the loopwise expansion. These tools are illustrated by systematic derivations of self-consistency equations, going beyond the mean-field approximation. These methods are applied to the pairwise maximum entropy (Ising spin) model, including the recently-found diagrammatic derivation of the Thouless-Anderson-Palmer mean field theory.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑