arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.12979cs.AIcs.NEq-bio.NC
收藏

预测编码:理论与实验研究综述

Predictive Coding: a Theoretical and Experimental Review

University of Edinburgh(爱丁堡大学);University of Sussex(萨塞克斯大学)

Beren Millidge, Anil Seth, Christopher L Buckley

摘要:

预测编码提供了一个潜在的统一的解释皮质功能-假设大脑的核心功能是最大限度地减少预测错误相对于生成模型的世界。该理论与贝叶斯大脑框架密切相关,在过去的二十年中,在理论和认知神经科学领域产生了重大影响。大量的研究已经出现的基础上,经验测试改进和扩展的理论和数学模型的预测编码,以及在评估其潜在的生物学的可行性,在大脑中的实施和具体的神经生理和心理预测的理论。尽管这种持久的普及,但是,没有全面的审查预测编码理论,特别是在这一领域的最新发展,存在。在这里,我们对预测编码的核心数学结构和逻辑进行了全面的回顾,从而补充了文献中最近的教程。我们还回顾了广泛的经典和最近的工作框架内,从神经生物学现实的微电路,可以实现预测编码,预测编码和广泛使用的误差反向传播算法之间的密切关系,以及调查预测编码和现代机器学习技术之间的密切关系。

英文摘要:

Predictive coding offers a potentially unifying account of cortical function -- postulating that the core function of the brain is to minimize prediction errors with respect to a generative model of the world. The theory is closely related to the Bayesian brain framework and, over the last two decades, has gained substantial influence in the fields of theoretical and cognitive neuroscience. A large body of research has arisen based on both empirically testing improved and extended theoretical and mathematical models of predictive coding, as well as in evaluating their potential biological plausibility for implementation in the brain and the concrete neurophysiological and psychological predictions made by the theory. Despite this enduring popularity, however, no comprehensive review of predictive coding theory, and especially of recent developments in this field, exists. Here, we provide a comprehensive review both of the core mathematical structure and logic of predictive coding, thus complementing recent tutorials in the literature. We also review a wide range of classic and recent work within the framework, ranging from the neurobiologically realistic microcircuits that could implement predictive coding, to the close relationship between predictive coding and the widely-used backpropagation of error algorithm, as well as surveying the close relationships between predictive coding and modern machine learning techniques.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑