资源约束下神经模块特化的动力学
Dynamics of specialization in neural modules under resource constraints
AI总结:
本研究利用人工神经网络发现结构模块化不足以保证功能特化,其涌现依赖于环境特征可分离性、网络资源约束及信息流动的时序与带宽,表明静态特化概念过于简单。
摘要:
长期以来,人们一直认为大脑在结构和功能上都是高度模块化的,尽管最近的证据使一些人对这两类模块化的程度产生了质疑。我们使用人工神经网络测试了结构模块化足以保证功能特化的假设,并发现通常情况下这并不必然成立。随后,我们系统地测试了环境和网络的哪些特征确实导致了特化的出现。我们使用了一个简单的玩具环境、任务和网络,使我们能够进行精确控制,并展示了在这种设置下,几种不同的特化度量给出了定性相似的结果。我们进一步发现,在这种设置下:(1)特化只能在环境特征具有可意义分离性的环境中出现;(2)当网络受到强烈的资源约束时,特化会优先出现;(3)这些发现在我们测试的不同网络架构变体中定性相似,但定量关系取决于具体的架构。最后,我们表明功能特化随时间动态变化,并证明这些动力学依赖于网络中信息流动的时序和带宽。我们得出结论,基于结构模块化的静态特化概念,对于理解从生物学到受大脑启发的神经形态系统等现实世界复杂性情境下的智能而言,可能是一个过于简单的框架。我们提出,在扩展到更复杂的数据、网络模型和电生理记录之前,在简化场景中对功能模块化的候选定义进行彻底的压力测试,可能是一种富有成效的方法。
英文摘要:
It has long been believed that the brain is highly modular both in terms of structure and function, although recent evidence has led some to question the extent of both types of modularity. We used artificial neural networks to test the hypothesis that structural modularity is sufficient to guarantee functional specialization, and find that in general, this doesn't necessarily hold. We then systematically tested which features of the environment and network do lead to the emergence of specialization. We used a simple toy environment, task and network, allowing us precise control, and show that in this setup, several distinct measures of specialization give qualitatively similar results. We further find that in this setup (1) specialization can only emerge in environments where features of that environment are meaningfully separable, (2) specialization preferentially emerges when the network is strongly resource-constrained, and (3) these findings are qualitatively similar across the different variations of network architectures that we tested, but that the quantitative relationships depend on the precise architecture. Finally, we show that functional specialization varies dynamically across time, and demonstrate that these dynamics depend on both the timing and bandwidth of information flow in the network. We conclude that a static notion of specialization, based on structural modularity, is likely too simple a framework for understanding intelligence in situations of real-world complexity, from biology to brain-inspired neuromorphic systems. We propose that thoroughly stress testing candidate definitions of functional modularity in simplified scenarios before extending to more complex data, network models and electrophysiological recordings is likely to be a fruitful approach.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。