arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1603.06353cs.NEmath.OCq-bio.NC
收藏

非负稀疏逼近的不连续神经网络

A Discontinuous Neural Network for Non-Negative Sparse Approximation

Martijn Arts, Marius Cordts, Monika Gorin, Marc Spehr, Rudolf Mathar

摘要:

本文研究了一个不连续的神经网络,它被用作哺乳动物嗅觉系统的模型,可以更普遍地应用于解决非负稀疏逼近问题。通过固有地限制系统积分器具有非负输出,系统函数变得不连续,因为积分器在不活动和活动之间切换。结果表明,所提出的网络收敛到平衡点,这是一般的非负最小二乘优化问题的解决方案。我们指定一个Caratheodory解决方案,并证明了网络是稳定的,只要系统矩阵具有完整的列秩。在平衡点上的一个温和的条件下,我们证明了网络收敛到它的平衡在有限数量的开关。示出了神经网络的两个应用。首先,我们将网络作为嗅觉系统的模型,并表明在原则上它可能能够执行复杂的稀疏信号恢复任务。其次,我们推广的应用程序,包括非负稀疏逼近问题,并比较恢复性能的一个经典的非负基追踪去噪算法。我们的结论是,恢复性能仅略有不同,从经典的算法,而神经网络的优点是,没有性能关键正则化参数必须选择之前恢复。

英文摘要:

This paper investigates a discontinuous neural network which is used as a model of the mammalian olfactory system and can more generally be applied to solve non-negative sparse approximation problems. By inherently limiting the systems integrators to having non-negative outputs, the system function becomes discontinuous since the integrators switch between being inactive and being active. It is shown that the presented network converges to equilibrium points which are solutions to general non-negative least squares optimization problems. We specify a Caratheodory solution and prove that the network is stable, provided that the system matrix has full column-rank. Under a mild condition on the equilibrium point, we show that the network converges to its equilibrium within a finite number of switches. Two applications of the neural network are shown. Firstly, we apply the network as a model of the olfactory system and show that in principle it may be capable of performing complex sparse signal recovery tasks. Secondly, we generalize the application to include non-negative sparse approximation problems and compare the recovery performance to a classical non-negative basis pursuit denoising algorithm. We conclude that the recovery performance differs only marginally from the classical algorithm, while the neural network has the advantage that no performance critical regularization parameter has to be chosen prior to recovery.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑