arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1901.02478q-bio.NC
收藏

机器学习和大脑中的视觉新奇感、好奇心和内在奖励

Visual novelty, curiosity, and intrinsic reward in machine learning and the brain

Andrew Jaegle, Vahid Mehrpour, Nicole Rust

摘要:

对新奇事物的强烈偏好出现在婴儿期,并在动物王国中普遍存在。当将视觉新奇性结合到基于探索的机器学习算法中时,视觉新奇性可以作为一种内在的奖励信号,极大地提高探索的效率并加快学习,特别是在难以获得外部奖励的情况下。在这里,我们回顾了新颖性驱动的机器学习算法的最新发展与我们对灵长类动物大脑中视觉新颖性如何计算和发出信号的理解之间的相似之处。我们建议,在视觉系统中,新奇的表征配置的主要目标是检测新的对象,而是与更广泛的目标,灵活地概括新奇的信息在不同的状态,在驱动基于新奇的学习服务。

英文摘要:

A strong preference for novelty emerges in infancy and is prevalent across the animal kingdom. When incorporated into reinforcement-based machine learning algorithms, visual novelty can act as an intrinsic reward signal that vastly increases the efficiency of exploration and expedites learning, particularly in situations where external rewards are difficult to obtain. Here we review parallels between recent developments in novelty-driven machine learning algorithms and our understanding of how visual novelty is computed and signaled in the primate brain. We propose that in the visual system, novelty representations are not configured with the principal goal of detecting novel objects, but rather with the broader goal of flexibly generalizing novelty information across different states in the service of driving novelty-based learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑