基于局部信息论目标函数的可解释神经学习通用框架
A General Framework for Interpretable Neural Learning based on Local Information-Theoretic Goal Functions
AI总结:
本文提出一种基于局部信息论目标函数的通用可解释神经学习框架,通过部分信息分解推导参数化局部学习规则,构建信息形态神经网络,并展示其在监督、无监督和记忆学习任务中的多功能性。
摘要:
尽管生物和人工网络具有令人瞩目的性能,但对其局部学习动态如何促进网络级任务解决方案的直观理解至今仍是一个挑战。将学习推向更局部尺度的努力确实带来了有价值的见解,然而,一种既具有可解释性又能适应多种任务的通用构造性方法来描述局部学习目标仍然缺失。我们先前为一个具有区室结构的模型神经元制定了一个高度适应性和可解释的局部信息处理目标。基于部分信息分解(PID)的最新进展,我们在此推导出相应的参数化局部学习规则,从而引入“信息形态”(infomorphic)神经网络。我们展示了这些网络在执行监督、无监督和记忆学习任务方面的多功能性。通过利用PID框架的可解释性,信息形态网络代表了一种有价值的工具,以增进我们对局部学习复杂结构的理解。
英文摘要:
Despite the impressive performance of biological and artificial networks, an intuitive understanding of how their local learning dynamics contribute to network-level task solutions remains a challenge to this date. Efforts to bring learning to a more local scale indeed lead to valuable insights, however, a general constructive approach to describe local learning goals that is both interpretable and adaptable across diverse tasks is still missing. We have previously formulated a local information processing goal that is highly adaptable and interpretable for a model neuron with compartmental structure. Building on recent advances in Partial Information Decomposition (PID), we here derive a corresponding parametric local learning rule, which allows us to introduce 'infomorphic' neural networks. We demonstrate the versatility of these networks to perform tasks from supervised, unsupervised and memory learning. By leveraging the interpretable nature of the PID framework, infomorphic networks represent a valuable tool to advance our understanding of the intricate structure of local learning.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。