不变识别驱动动作序列的神经表征
Invariant recognition drives neural representations of action sequences
摘要:
从视觉刺激中识别他人的行为是人类视觉感知的一个重要方面,它允许个体对社会线索做出反应。人类能够识别相似的行为,并区分不同的动作,尽管变换,如视角或演员的变化,大大改变了场景的视觉外观。这种在复杂变换中进行概括的能力是人类视觉智能的标志。在神经水平上理解运动知觉的进展并不总是能准确地解释我们的视觉皮层进化或学习计算的表征背后的计算原理。在这里,我们测试的假设,不变的行动歧视可能会填补这一空白。最近,对静态对象感知的人工系统的研究已经产生了在复杂的辨别任务中实现人类水平性能的模型,CNN。在这类模型中,更好地支持不变对象识别的架构也会产生与人类和灵长类动物神经数据所暗示的图像表示相匹配的图像表示。然而,这些模型是否产生支持跨复杂变换识别的动作序列表示,并密切遵循神经表示仍然是未知的。在这里,我们表明时空CNN适当地将视频刺激分类为动作,并且故意修改模型以提高不变动作识别任务的性能,从而导致更好地匹配人类神经记录的数据表示。我们的研究结果支持我们的假设,不变的歧视性能决定了人类视觉皮层计算的行动的神经表征。
英文摘要:
Recognizing the actions of others from visual stimuli is a crucial aspect of human visual perception that allows individuals to respond to social cues. Humans are able to identify similar behaviors and discriminate between distinct actions despite transformations, like changes in viewpoint or actor, that substantially alter the visual appearance of a scene. This ability to generalize across complex transformations is a hallmark of human visual intelligence. Advances in understanding motion perception at the neural level have not always translated in precise accounts of the computational principles underlying what representation our visual cortex evolved or learned to compute. Here we test the hypothesis that invariant action discrimination might fill this gap. Recently, the study of artificial systems for static object perception has produced models, CNNs, that achieve human level performance in complex discriminative tasks. Within this class of models, architectures that better support invariant object recognition also produce image representations that match those implied by human and primate neural data. However, whether these models produce representations of action sequences that support recognition across complex transformations and closely follow neural representations remains unknown. Here we show that spatiotemporal CNNs appropriately categorize video stimuli into actions, and that deliberate model modifications that improve performance on an invariant action recognition task lead to data representations that better match human neural recordings. Our results support our hypothesis that performance on invariant discrimination dictates the neural representations of actions computed by human visual cortex.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。