arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1911.09451q-bio.NC
收藏

虚拟啮齿动物的深层神经行为学

Deep neuroethology of a virtual rodent

Josh Merel, Diego Aldarondo, Jesse Marshall, Yuval Tassa, Greg Wayne, Bence Ölveczky

摘要:

神经科学和深度学习的并行发展导致了相互富有成效的交流,推动了我们对感官和认知系统中真实和人工神经网络的理解。然而,这种场之间的相互作用在运动控制的研究中较少。在这项工作中,我们开发了一个虚拟的啮齿动物作为接地的研究体现控制的人工模型中的运动活动的平台。然后,我们使用这个平台通过训练一个模型来解决四个复杂的任务,来研究不同背景下的运动活动。使用熟悉的神经科学家的方法,我们描述的行为表示和算法所采用的不同层的网络使用神经行为学的方法来表征运动活动相对于啮齿动物的行为和目标。我们发现,该模型使用两类表示,分别编码特定于任务的行为策略和任务不变的行为运动学。这些表征反映在神经亚群的序列活动和种群动力学中。总的来说,虚拟啮齿动物促进了深度强化学习和运动神经科学之间的基础合作。

英文摘要:

Parallel developments in neuroscience and deep learning have led to mutually productive exchanges, pushing our understanding of real and artificial neural networks in sensory and cognitive systems. However, this interaction between fields is less developed in the study of motor control. In this work, we develop a virtual rodent as a platform for the grounded study of motor activity in artificial models of embodied control. We then use this platform to study motor activity across contexts by training a model to solve four complex tasks. Using methods familiar to neuroscientists, we describe the behavioral representations and algorithms employed by different layers of the network using a neuroethological approach to characterize motor activity relative to the rodent's behavior and goals. We find that the model uses two classes of representations which respectively encode the task-specific behavioral strategies and task-invariant behavioral kinematics. These representations are reflected in the sequential activity and population dynamics of neural subpopulations. Overall, the virtual rodent facilitates grounded collaborations between deep reinforcement learning and motor neuroscience.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑