统计物理与真实和人工神经网络的表示
Statistical Physics and Representations in Real and Artificial Neural Networks
摘要:
本文档介绍了两个讲座的材料统计物理和神经表示,由我们之一(RM)。在统计物理学的基本问题XIV暑期学校在2017年7月。在第一部分中,我们考虑海马中空间(地图)的神经表征。我们介绍了一个扩展的Hopfield模型,能够存储多个空间地图作为连续的,有限维吸引子。分析了该模型的相图和动力学性质。然后,我们将展示如何使用有效的伊辛模型捕捉神经数据中的相关结构的空间表示可以动态解码,并比较应用程序从海马多电极记录和(子)采样我们的吸引子模型获得的数据。在第二部分中,我们专注于机器学习中的学习数据表示问题,特别是人工神经网络。我们首先通过一些插图介绍数据表示。然后,我们分析了两个重要的算法,主成分分析和限制玻尔兹曼机,从统计物理的工具。
英文摘要:
This document presents the material of two lectures on statistical physics and neural representations, delivered by one of us (R.M.) at the Fundamental Problems in Statistical Physics XIV summer school in July 2017. In a first part, we consider the neural representations of space (maps) in the hippocampus. We introduce an extension of the Hopfield model, able to store multiple spatial maps as continuous, finite-dimensional attractors. The phase diagram and dynamical properties of the model are analyzed. We then show how spatial representations can be dynamically decoded using an effective Ising model capturing the correlation structure in the neural data, and compare applications to data obtained from hippocampal multi-electrode recordings and by (sub)sampling our attractor model. In a second part, we focus on the problem of learning data representations in machine learning, in particular with artificial neural networks. We start by introducing data representations through some illustrations. We then analyze two important algorithms, Principal Component Analysis and Restricted Boltzmann Machines, with tools from statistical physics.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。