arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.04072cs.LGstat.ML
收藏

基于贝叶斯概念学习的数值序列预测

Numerical Sequence Prediction using Bayesian Concept Learning

Courant Institute of Mathematical Sciences, New York University(纽约大学库朗数学科学研究所)

Mohith Damarapati, Inavamsi B. Enaganti, Alfred Ajay Aureate Rajakumar

摘要:

当人们学习数学模式或序列时,他们能够识别这些模式背后的概念(或规则)。在学习了基本概念之后,人类也能够将这些概念推广到其他数字,甚至可以识别这些规则的前所未见的组合。目前最先进的RNN架构(如LSTM)在预测连续数据的连续元素方面表现良好,但需要大量的训练样本。即使有大量的数据,这些模型也很难概括概念。从我们的行为研究中,我们还发现人类能够忽视噪音并识别产生损坏序列的潜在规则。因此,我们提出了一个贝叶斯模型,它可以捕获这些类似人类的学习能力,以预测给定序列中的下一个数字,比传统的LSTM更好。

英文摘要:

When people learn mathematical patterns or sequences, they are able to identify the concepts (or rules) underlying those patterns. Having learned the underlying concepts, humans are also able to generalize those concepts to other numbers, so far as to even identify previously unseen combinations of those rules. Current state-of-the art RNN architectures like LSTMs perform well in predicting successive elements of sequential data, but require vast amounts of training examples. Even with extensive data, these models struggle to generalize concepts. From our behavioral study, we also found that humans are able to disregard noise and identify the underlying rules generating the corrupted sequences. We therefore propose a Bayesian model that captures these human-like learning capabilities to predict next number in a given sequence, better than traditional LSTMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑