arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.04132q-bio.NCcs.AIcs.CVcs.RO
收藏

作为操作大脑的涌现特性的数感

A Number Sense as an Emergent Property of the Manipulating Brain

California Institute of Technology(加州理工学院)

Neehar Kondapaneni, Pietro Perona

AI总结:

本研究通过构建一个结合视觉感知与运动系统监督信号的跨模态深度学习模型,在无目的物体操作的动作预测任务中,发现模型自发涌现出对数字和数量的感知与表示能力,为人工智能中的跨模态学习机制提供了新见解。

摘要:

理解和操作数字与数量的能力在童年时期出现,但人类获取和发展这种能力的机制仍知之甚少。我们通过一个模型探索这个问题,假设学习者能够拾取小物体并将其放置到自选的位置,并且会自发地进行这种无目的的操作。我们进一步假设学习者的视觉系统将监控场景中物体排列的变化,并通过将感知与来自运动系统的监督信号进行比较,学习预测每个动作的效果。我们使用用于特征提取和分类的标准深度网络以及梯度下降学习来建模感知。我们的主要发现是,从学习动作预测任务中,出现了一种意想不到的图像表示,展现出预示数字和数量感知与表示的规律性。这包括零和前几个自然数的独特类别,数字的严格排序,以及与数值量相关的一维信号。因此,我们的模型获得了估计数量(即场景中物体的数量)的能力,以及瞬间识别(即一眼认出小场景中物体确切数量的能力)。值得注意的是,瞬间识别和数量估计可外推到包含许多物体的场景,远远超出了训练期间使用的三个物体。我们得出结论,数字和数量能力的重要方面可以通过简单预训练任务的监督来学习。我们的观察表明,跨模态学习是一种强大的学习机制,可以在人工智能中加以利用。

英文摘要:

The ability to understand and manipulate numbers and quantities emerges during childhood, but the mechanism through which humans acquire and develop this ability is still poorly understood. We explore this question through a model, assuming that the learner is able to pick up and place small objects from, and to, locations of its choosing, and will spontaneously engage in such undirected manipulation. We further assume that the learner's visual system will monitor the changing arrangements of objects in the scene and will learn to predict the effects of each action by comparing perception with a supervisory signal from the motor system. We model perception using standard deep networks for feature extraction and classification, and gradient descent learning. Our main finding is that, from learning the task of action prediction, an unexpected image representation emerges exhibiting regularities that foreshadow the perception and representation of numbers and quantity. These include distinct categories for zero and the first few natural numbers, a strict ordering of the numbers, and a one-dimensional signal that correlates with numerical quantity. As a result, our model acquires the ability to estimate numerosity, i.e. the number of objects in the scene, as well as subitization, i.e. the ability to recognize at a glance the exact number of objects in small scenes. Remarkably, subitization and numerosity estimation extrapolate to scenes containing many objects, far beyond the three objects used during training. We conclude that important aspects of a facility with numbers and quantities may be learned with supervision from a simple pre-training task. Our observations suggest that cross-modal learning is a powerful learning mechanism that may be harnessed in artificial intelligence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑