在有限大小神经网络的部分观测下,对均场模型的参数和隐藏状态进行推断
Parameter and hidden-state inference in mean-field models from partial observations of finite-size neural networks
AI总结:
本文提出了一种在有限大小神经网络部分观测下,通过微分进化算法推断均场模型参数并重建隐藏状态的方法,验证了其在周期性和混沌动态网络中的有效性。
摘要:
我们研究了在热力学极限下可以接受精确低维均场描述的大型但有限的神经网络。我们假设描述宏观量(如平均放电率或平均膜电位)的均场方程是已知的,但其参数未知。此外,只假设有限网络中的一个标量宏观可观测量是可以测量的。利用该可观测量的时间序列数据,我们推断均场方程的未知参数并重建未观测(隐藏)宏观变量的动力学。参数估计使用微分进化算法进行。为了消除损失函数对隐藏变量未知初始条件的依赖,我们在优化过程中将均场模型与有限网络同步。我们在两个具有二次积分-放电神经元的网络上演示了该方法:一个表现出周期性集体振荡,另一个表现出混沌集体动态。在两种情况下,网络大小超过1000个神经元时,参数的恢复相对误差低于1%。
英文摘要:
We study large but finite neural networks that, in the thermodynamic limit, admit an exact low-dimensional mean-field description. We assume that the governing mean-field equations describing macroscopic quantities such as the mean firing rate or mean membrane potential are known, while their parameters are not. Moreover, only a single scalar macroscopic observable from the finite network is assumed to be measurable. Using time-series data of this observable, we infer the unknown parameters of the mean-field equations and reconstruct the dynamics of unobserved (hidden) macroscopic variables. Parameter estimation is carried out using the differential evolution algorithm. To remove the dependence of the loss function on the unknown initial conditions of the hidden variables, we synchronize the mean-field model with the finite network throughout the optimization process. We demonstrate the methodology on two networks of quadratic integrate-and-fire neurons: one exhibiting periodic collective oscillations and another displaying chaotic collective dynamics. In both cases, the parameters are recovered with relative errors below $1\%$ for network sizes exceeding 1000 neurons.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。