小脑突触的前向模型促进小脑预测性控制
A Forward Model at Purkinje Cell Synapses Facilitates Cerebellar Anticipatory Control
AI总结:
本文提出了一种基于小脑的预测性控制架构,通过前向模块和误差反馈控制器的交互,利用突触水平的学习规则实现适应性控制。
摘要:
我们的运动系统如何在不同肌肉骨骼系统响应动力学、运输延迟及中枢神经系统响应延迟的广泛谱系下解决预测性控制问题?很大程度上,我们高技能的运动反应是源于脑干和脊髓的反馈系统与由小脑起源的前馈预测系统相结合的结果,后者通过感觉经验进行适应性微调。基于这种交互,我们设计了反事实预测控制(CFPC)架构,一种预测性适应性运动控制方案,其中基于小脑的前向模块通过反事实误差信号驱动误差反馈控制器。这些信号触发反应如同实际误差一样,但不编码任何当前或即将发生的误差。为了确定最优学习策略,我们推导出一种新的学习规则用于前向模块,该规则涉及一种资格追踪并作用于突触水平。特别是,我们的资格追踪提供了一种超越巧合检测的机制,即通过历史的先前突触输入与误差信号进行卷积。在小脑生理学的背景下,这一解决方案意味着绒细胞突触应使用被控系统的前向模型生成资格追踪。从工程角度看,CFPC提供了一种通用的预测性控制架构,配备了利用闭环系统完整动态的学习规则。
英文摘要:
How does our motor system solve the problem of anticipatory control in spite of a wide spectrum of response dynamics from different musculo-skeletal systems, transport delays as well as response latencies throughout the central nervous system? To a great extent, our highly-skilled motor responses are a result of a reactive feedback system, originating in the brain-stem and spinal cord, combined with a feed-forward anticipatory system, that is adaptively fine-tuned by sensory experience and originates in the cerebellum. Based on that interaction we design the counterfactual predictive control (CFPC) architecture, an anticipatory adaptive motor control scheme in which a feed-forward module, based on the cerebellum, steers an error feedback controller with counterfactual error signals. Those are signals that trigger reactions as actual errors would, but that do not code for any current or forthcoming errors. In order to determine the optimal learning strategy, we derive a novel learning rule for the feed-forward module that involves an eligibility trace and operates at the synaptic level. In particular, our eligibility trace provides a mechanism beyond co-incidence detection in that it convolves a history of prior synaptic inputs with error signals. In the context of cerebellar physiology, this solution implies that Purkinje cell synapses should generate eligibility traces using a forward model of the system being controlled. From an engineering perspective, CFPC provides a general-purpose anticipatory control architecture equipped with a learning rule that exploits the full dynamics of the closed-loop system.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。