arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1601.01358q-bio.NC
收藏

视觉系统中人类动作的快速不变表示

Fast, invariant representation for human action in the visual system

Leyla Isik, Andrea Tacchetti, Tomaso Poggio

摘要:

人类可以毫不费力地识别其他人在复杂变换中的行为,例如视角的变化。一些研究已经定位了大脑中参与不变动作识别的区域,然而,对底层的神经计算仍然知之甚少。我们使用脑磁图(MEG)解码和一个由不同演员在不同视角执行的五个动作(跑,走,跳,吃,喝)的控制良好的自然视频数据集来研究用于识别复杂变换动作的计算步骤。特别是,我们问大脑何时会考虑3D视角的变化,而不是最初区分动作的时候。当受试者观看完整视频以及形式耗尽和运动耗尽的刺激时,我们测量了不变和非不变动作解码之间的延迟差异。我们的研究结果表明,在完整的视频中不变和非不变的动作识别之间的解码延迟或时间配置文件没有差异。然而,当形式或运动信息被从刺激集中删除时,我们观察到不变动作解码的减少和延迟。我们的研究结果表明,大脑在识别动作的同时,对复杂的变换建立不变性,并且形式和运动信息对于快速、不变的动作识别至关重要。

英文摘要:

Humans can effortlessly recognize others' actions in the presence of complex transformations, such as changes in viewpoint. Several studies have located the regions in the brain involved in invariant action recognition, however, the underlying neural computations remain poorly understood. We use magnetoencephalography (MEG) decoding and a dataset of well-controlled, naturalistic videos of five actions (run, walk, jump, eat, drink) performed by different actors at different viewpoints to study the computational steps used to recognize actions across complex transformations. In particular, we ask when the brain discounts changes in 3D viewpoint relative to when it initially discriminates between actions. We measure the latency difference between invariant and non-invariant action decoding when subjects view full videos as well as form-depleted and motion-depleted stimuli. Our results show no difference in decoding latency or temporal profile between invariant and non-invariant action recognition in full videos. However, when either form or motion information is removed from the stimulus set, we observe a decrease and delay in invariant action decoding. Our results suggest that the brain recognizes actions and builds invariance to complex transformations at the same time, and that both form and motion information are crucial for fast, invariant action recognition.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑