The principle of maximum entropy provides a useful method for inferring statistical mechanics models from observations in correlated systems, and is widely used in a variety of fields where accurate data are available. While the assumptions underlying maximum entropy are intuitive and appealing, its adequacy for describing complex empirical data has been little studied in comparison to alternative approaches. Here data from the collective spiking activity of retinal neurons is reanalysed. The accuracy of the maximum entropy distribution constrained by mean firing rates and pairwise correlations is compared to a random ensemble of distributions constrained by the same observables. In general, maximum entropy approximates the true distribution better than the typical or mean distribution from that ensemble. This advantage improves with population size, with groups as small as 8 being almost always better described by maximum entropy. Failure of maximum entropy to outperform random models is found to be associated with strong correlations in the population.
State-space kinetic Ising model reveals task-dependent entropy flow in sparsely active nonequilibrium neuronal dynamics
Graduate School of Life Science, Hokkaido University(北海道大学生命科学学院);Center for Human Nature, Artificial Intelligence, and Neuroscience (CHAIN), Hokkaido University(北海道大学人类本性、人工智能与神经科学中心(CHAIN));Graduate School of Informatics, Kyoto University(京都大学情报学研究科)
Feature leakage and the identifiability of direct-dependency entropy models of neural activity
Kempner Institute for the Study of Natural and Artificial Intelligence at Harvard University(哈佛大学生物自然与人工智能研究所);Department of Neurobiology, Howard Hughes Medical Institute, Harvard Medical School(哈佛医学院神经生物学系霍华德休斯医学研究所)