arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.02371cs.NEcs.AIcs.ARcs.LG
收藏

一种受皮层启发的新型分层事件回忆器架构

Architecture of a Cortex Inspired Hierarchical Event Recaller

Universidad de Cantabria(坎塔布里亚大学)

Valentin Puente Varona

AI总结:

本文提出一种受小脑皮层启发的分层事件回忆器架构,通过无监督连续上下文学习与预测机制,在极少训练数据和简单计算原语下实现复杂时间序列(如语音)的识别与预测,并具备低硬件成本潜力。

摘要:

本文提出了一种新的机器学习(ML)方法,重点关注复杂模式的无监督、连续、上下文相关学习。尽管该方案部分受到当前关于哺乳动物大脑结构和功能特性的一些知识的启发,但我们并不声称生物系统以类似方式工作(也不声称相反)。基于小脑皮层及邻近结构的一些特性,提出了一种适用于实际问题的方案。将定义并实验测试一种能够识别和预测复杂时间序列的合成结构。该系统在很大程度上依赖预测来帮助基于先前获得的上下文知识识别和学习模式。作为概念验证,所提出的系统被证明能够在没有任何先验知识的情况下,学习、识别和预测一个极其复杂的时间序列,例如人类语音。从原始数据出发,在核心算法没有任何改动的情况下,该系统能够从一组西班牙语句子中识别出某些语音结构。与传统机器学习不同,该方案可以在减少训练集的情况下进行学习。尽管该思想可以应用于受限问题,例如语音中未知词汇的检测,但它也可以用于更多应用,如视觉,或(通过加入缺失的生物外围结构)融入其他机器学习技术。鉴于所使用的计算原语非常简单,潜在的硬件实现将非常节俭。巧合的是,所提出的模型不仅符合生物系统的一个合理功能框架,而且还可能解释许多难以捉摸的认知现象。

英文摘要:

This paper proposes a new approach to Machine Learning (ML) that focuses on unsupervised continuous context-dependent learning of complex patterns. Although the proposal is partly inspired by some of the current knowledge about the structural and functional properties of the mammalian brain, we do not claim that biological systems work in an analogous way (nor the opposite). Based on some properties of the cerebellar cortex and adjacent structures, a proposal suitable for practical problems is presented. A synthetic structure capable of identifying and predicting complex temporal series will be defined and experimentally tested. The system relies heavily on prediction to help identify and learn patterns based on previously acquired contextual knowledge. As a proof of concept, the proposed system is shown to be able to learn, identify and predict a remarkably complex temporal series such as human speech, with no prior knowledge. From raw data, without any adaptation in the core algorithm, the system is able to identify certain speech structures from a set of Spanish sentences. Unlike conventional ML, the proposal can learn with a reduced training set. Although the idea can be applied to a constrained problem, such as the detection of unknown vocabulary in a speech, it could be used in more applications, such as vision, or (by incorporating the missing biological periphery) fit into other ML techniques. Given the trivial computational primitives used, a potential hardware implementation will be remarkably frugal. Coincidentally, the proposed model not only conforms to a plausible functional framework for biological systems but may also explain many elusive cognitive phenomena.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑