arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.05710q-bio.NCcs.AIcs.LG
收藏

基于神经网络的预测事件分割与表示:一种基于心理学实验的自监督模型

Predictive Event Segmentation and Representation with Neural Networks: A Self-Supervised Model Assessed by Psychological Experiments

University of Tübingen(蒂宾根大学);Boğaziçi University(海峡大学)

Hamit Basgol, Inci Ayhan, Emre Ugur

摘要:

人们将复杂、不断变化和连续的体验分割成基本、稳定和离散的时空体验单元,称为事件。事件分割文献研究了允许人们提取事件的机制。事件分割理论指出,人们预测正在进行的活动,并观察预测错误信号,以找到使事件分开的事件边界。在这项研究中,我们调查的机制,引起这种能力的计算模型和伴随的心理实验。受事件分割理论和预测处理的启发,提出了一种自监督的事件分割模型。该模型由神经网络和认知模型组成,神经网络预测下一个时间步中的感觉信号以表示不同的事件,认知模型根据预测误差调节这些网络。为了验证我们的模型在分割事件、在被动观察过程中学习事件以及在其内部表示空间中表示事件方面的能力,我们准备了一个视频,该视频描述了由点光显示器表示的人类行为。我们比较了事件分割行为的参与者和我们的模型与这个视频在两个层次的事件分割水平。通过使用点二阶相关技术,我们证明了我们的模型的事件分割决策与参与者的反应相关。此外,通过近似的代表空间的参与者的相似性为基础的技术,我们表明,我们的模型形成了一个类似的代表空间的参与者。结果表明,我们跟踪预测误差信号的模型可以产生类似人类的事件边界和事件表示。最后,我们讨论了我们对事件认知文献的贡献,以及我们对事件分割如何在大脑中实现的理解。

英文摘要:

People segment complex, ever-changing and continuous experience into basic, stable and discrete spatio-temporal experience units, called events. Event segmentation literature investigates the mechanisms that allow people to extract events. Event segmentation theory points out that people predict ongoing activities and observe prediction error signals to find event boundaries that keep events apart. In this study, we investigated the mechanism giving rise to this ability by a computational model and accompanying psychological experiments. Inspired from event segmentation theory and predictive processing, we introduced a self-supervised model of event segmentation. This model consists of neural networks that predict the sensory signal in the next time-step to represent different events, and a cognitive model that regulates these networks on the basis of their prediction errors. In order to verify the ability of our model in segmenting events, learning them during passive observation, and representing them in its internal representational space, we prepared a video that depicts human behaviors represented by point-light displays. We compared event segmentation behaviors of participants and our model with this video in two hierarchical event segmentation levels. By using point-biserial correlation technique, we demonstrated that event segmentation decisions of our model correlated with the responses of participants. Moreover, by approximating representation space of participants by a similarity-based technique, we showed that our model formed a similar representation space with those of participants. The result suggests that our model that tracks the prediction error signals can produce human-like event boundaries and event representations. Finally, we discussed our contribution to the literature of event cognition and our understanding of how event segmentation is implemented in the brain.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑