从内部模型到元认知AI
From internal models toward metacognitive AI
摘要:
在20世纪80年代和90年代发表在《生物控制论》上的几篇论文中,Kawato和他的同事提出了计算模型,解释了小脑内部模型是如何获得的。这些模型后来得到了猴子神经生理学实验和人类神经成像实验的支持。这些早期的研究影响了神经科学,从基本的感觉运动控制到更高的认知功能。与内部模型相关的最令人困惑的谜团之一是理解使动物能够在如此少的试验中学习大维度问题的神经机制。意识和元认知--监控自己思想的能力,可能是解决这个谜团的一部分。本文在总结近20年来相关文献的基础上,提出了一个元认知的计算神经科学模型。该模型包括一个模块化的层次并行和分层,生成逆模型对学习架构。在前额叶皮层,一个被称为“认知现实监控网络”(CRMN)的分布式执行网络协调了感知和行动中生成逆模型对的有意识参与。基于生成模型和逆模型的计算之间的不匹配,以及奖励预测错误,CRMN计算出一个“责任信号”,该信号在感知、动作和强化学习中选择和学习配对。高责任信号被给予最好地捕捉外部世界的对,在运动中有能力(小失配),并且能够进行强化学习(小奖励预测误差)。CRMN选择具有较高责任信号的配对作为元认知的对象,并且意识由跨所有配对的责任信号的熵确定。
英文摘要:
In several papers published in Biological Cybernetics in the 1980s and 1990s, Kawato and colleagues proposed computational models explaining how internal models are acquired in the cerebellum. These models were later supported by neurophysiological experiments using monkeys and neuroimaging experiments involving humans. These early studies influenced neuroscience from basic, sensory-motor control to higher cognitive functions. One of the most perplexing enigmas related to internal models is to understand the neural mechanisms that enable animals to learn large-dimensional problems with so few trials. Consciousness and metacognition -- the ability to monitor one's own thoughts, may be part of the solution to this enigma. Based on literature reviews of the past 20 years, here we propose a computational neuroscience model of metacognition. The model comprises a modular hierarchical reinforcement-learning architecture of parallel and layered, generative-inverse model pairs. In the prefrontal cortex, a distributed executive network called the "cognitive reality monitoring network" (CRMN) orchestrates conscious involvement of generative-inverse model pairs in perception and action. Based on mismatches between computations by generative and inverse models, as well as reward prediction errors, CRMN computes a "responsibility signal" that gates selection and learning of pairs in perception, action, and reinforcement learning. A high responsibility signal is given to the pairs that best capture the external world, that are competent in movements (small mismatch), and that are capable of reinforcement learning (small reward prediction error). CRMN selects pairs with higher responsibility signals as objects of metacognition, and consciousness is determined by the entropy of responsibility signals across all pairs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。