演化储备池计算机揭示了预测能力与涌现动力学之间的双向耦合
Evolving reservoir computers reveals bidirectional coupling between predictive power and emergent dynamics
AI总结:
本研究利用偏信息分解指标和储备池计算框架,揭示了预测性能与涌现动力学之间的双向耦合,并证明涌现动力学在生物启发计算架构的环境预测中发挥关键作用。
摘要:
生物神经网络能够执行复杂的计算来预测其环境,远超单个神经元的有限预测能力。尽管理解这些计算的传统方法通常侧重于分离单个神经元的贡献,但我们认为,更深层次的理解需要考虑涌现动力学——使整个系统“大于其各部分之和”的动力学。具体而言,我们通过利用源自偏信息分解的近期涌现定量指标,以及在被称为储备池计算的生物启发计算框架中对环境动力学预测进行建模,来检验预测性能与涌现之间的关系。值得注意的是,我们揭示了预测性能与涌现之间存在双向耦合,该耦合可泛化至不同的任务环境和储备池网络拓扑结构,并由三个关键结果所证实:1)优化超参数以提升性能会增强涌现动力学,反之亦然;2)涌现动力学在所有任务环境中代表了预测成功的近充分条件,并在大多数环境中是近必要条件;3)在更大数据集上训练储备池计算机会产生更强的涌现动力学,其中包含对性能至关重要的任务相关信息。总体而言,我们的研究指出了涌现动力学在促进生物启发计算架构进行环境预测方面的关键作用。
英文摘要:
Biological neural networks can perform complex computations to predict their environment, far above the limited predictive capabilities of individual neurons. While conventional approaches to understanding these computations often focus on isolating the contributions of single neurons, here we argue that a deeper understanding requires considering emergent dynamics - dynamics that make the whole system "more than the sum of its parts". Specifically, we examine the relationship between prediction performance and emergence by leveraging recent quantitative metrics of emergence, derived from Partial Information Decomposition, and by modelling the prediction of environmental dynamics in a bio-inspired computational framework known as reservoir computing. Notably, we reveal a bidirectional coupling between prediction performance and emergence, which generalises across task environments and reservoir network topologies, and is recapitulated by three key results: 1) Optimising hyperparameters for performance enhances emergent dynamics, and vice versa; 2) Emergent dynamics represent a near sufficient criterion for prediction success in all task environments, and an almost necessary criterion in most environments; 3) Training reservoir computers on larger datasets results in stronger emergent dynamics, which contain task-relevant information crucial for performance. Overall, our study points to a pivotal role of emergence in facilitating environmental predictions in a bio-inspired computational architecture.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。