基于相关性信息最大化的生物合理神经网络用于相关源分离
Correlative Information Maximization Based Biologically Plausible Neural Networks for Correlated Source Separation
AI总结:
本文提出一种生物合理的神经网络,通过最大化相关性信息传输并利用源域信息,克服了传统独立成分分析中潜在源必须独立的限制,实现了对相关源的卓越分离。
摘要:
大脑能够毫不费力地提取刺激的潜在原因,但它在网络层面如何做到这一点仍然未知。以往针对该问题的大多数尝试提出了实现独立成分分析的神经网络,但这受限于潜在原因相互独立的假设。在此,我们放宽了这一限制,提出了一种生物合理的神经网络,通过利用源域信息来提取相关的潜在源。为了推导该网络,我们选择在输出被限制在其假定集合的约束下,将输入到输出的最大相关性信息传输作为分离目标。该优化问题的在线形式自然导出了具有局部学习规则的神经网络。我们的框架融合了无限多种源域选择,并能灵活地建模复杂的潜在结构。选择单纯形或多面体源域会生成具有分段线性激活函数的网络。我们提供了数值示例,以证明其对合成源和自然源均具有卓越的相关源分离能力。
英文摘要:
The brain effortlessly extracts latent causes of stimuli, but how it does this at the network level remains unknown. Most prior attempts at this problem proposed neural networks that implement independent component analysis which works under the limitation that latent causes are mutually independent. Here, we relax this limitation and propose a biologically plausible neural network that extracts correlated latent sources by exploiting information about their domains. To derive this network, we choose maximum correlative information transfer from inputs to outputs as the separation objective under the constraint that the outputs are restricted to their presumed sets. The online formulation of this optimization problem naturally leads to neural networks with local learning rules. Our framework incorporates infinitely many source domain choices and flexibly models complex latent structures. Choices of simplex or polytopic source domains result in networks with piecewise-linear activation functions. We provide numerical examples to demonstrate the superior correlated source separation capability for both synthetic and natural sources.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。