arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1609.01459cs.AIcs.NE
收藏

偏差学习算法:通过时间和空间学习稀疏失配表示

Deviant Learning Algorithm: Learning Sparse Mismatch Representations through Time and Space

National Open University of Nigeria(尼日利亚国立开放大学);System Analytics Laboratories (SAL)(系统分析实验室);Sure-GP Ltd(Sure-GP有限公司)

Emmanuel Ndidi Osegi, Vincent Ike Anireh

摘要:

预测编码(Predictive Coding,PDC)作为神经元研究和人工神经网络实现的候选统一范式,特别是针对无监督学习系统,最近引起了神经科学和计算界的关注。失配负性(MMN)最近也被研究与PC有关,并发现是神经预测编码系统中的有用成分。在生物体行为的支持下,这种网络在形成时空转换和输入世界的不变表示方面特别有用。然而,大多数神经系统仍然没有考虑大量的突触,即使这已经被一些机器学习研究人员证明是任何神经系统的有效且非常重要的组成部分,如果这样的系统要正常工作的话。我们在这里的主要观点是,除了大量突触之外,具有MMN效应的PDC系统可以大大提高任何神经学习系统的性能和在机器世界中做出决策的能力。在本文中,我们提出了一种新的仿生计算智能算法-偏差学习算法,这些关键思想和功能特性的启发,最近的大脑认知发现和理论。我们还展示了由理论见解指导的数值实验,我们发明的仿生算法如何即使用非常小的问题特定数据也能实现有竞争力的预测。

英文摘要:

Predictive coding (PDC) has recently attracted attention in the neuroscience and computing community as a candidate unifying paradigm for neuronal studies and artificial neural network implementations particularly targeted at unsupervised learning systems. The Mismatch Negativity (MMN) has also recently been studied in relation to PC and found to be a useful ingredient in neural predictive coding systems. Backed by the behavior of living organisms, such networks are particularly useful in forming spatio-temporal transitions and invariant representations of the input world. However, most neural systems still do not account for large number of synapses even though this has been shown by a few machine learning researchers as an effective and very important component of any neural system if such a system is to behave properly. Our major point here is that PDC systems with the MMN effect in addition to a large number of synapses can greatly improve any neural learning system's performance and ability to make decisions in the machine world. In this paper, we propose a novel bio-mimetic computational intelligence algorithm -- the Deviant Learning Algorithm, inspired by these key ideas and functional properties of recent brain-cognitive discoveries and theories. We also show by numerical experiments guided by theoretical insights, how our invented bio-mimetic algorithm can achieve competitive predictions even with very small problem specific data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑