arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2004.10518cs.AIcs.CV
收藏

与对象信息无关的人机动作预测

Human and Machine Action Prediction Independent of Object Information

University of Göttingen(哥廷根大学);University of Münster(明斯特大学);Vytautas Magnus University(维陶塔斯·马格努斯大学)

Fatemeh Ziaeetabar, Jennifer Pomp, Stefan Pfeiffer, Nadiya El-Sourani, Ricarda I. Schubotz, Minija Tamosiunaite, Florentin Wörgötter

摘要:

预测他人的行为是成功的社会互动的关键,使我们能够根据他人未来行为的后果调整自己的行为。关于动作识别的研究集中在动作中涉及的物体的个体视觉特征及其上下文的重要性。然而,人类可以识别对未知物体的动作,甚至是想象中的物体(哑剧)。因此,其他线索必须弥补可识别的视觉对象特征的缺乏。在这里,我们关注的是在动作过程中发生变化的对象间关系的作用。我们设计了一个虚拟现实系统,并对50名受试者进行了10种不同操作动作的识别速度测试。所有对象都是由模拟多维数据集抽象的,因此无法使用对象信息推断操作。相反,受试者只能依靠这些立方体之间空间关系变化所产生的信息。尽管有这些限制,我们的研究结果表明,受试者能够预测的行动,平均不到64%的行动的持续时间。我们采用了一个计算模型-一个丰富的语义事件链(eSEC)-纳入空间关系的信息,特别是(a)对象的接触/不接触,(b)对象之间的静态空间关系和(c)对象之间的动态空间关系。经过与受试者观察到的相同动作的训练,该模型成功地预测了动作,甚至比人类更好。信息理论分析表明,eSEC最佳地使用个人线索,而人类可能主要依赖于混合线索策略,这需要更长的时间才能识别。提供更好的动作识别认知基础,一方面可以提高我们对相关人类病理学的理解,另一方面也有助于构建无冲突人机合作的机器人。我们的研究结果在这里开辟了新的途径。

英文摘要:

Predicting other people's action is key to successful social interactions, enabling us to adjust our own behavior to the consequence of the others' future actions. Studies on action recognition have focused on the importance of individual visual features of objects involved in an action and its context. Humans, however, recognize actions on unknown objects or even when objects are imagined (pantomime). Other cues must thus compensate the lack of recognizable visual object features. Here, we focus on the role of inter-object relations that change during an action. We designed a virtual reality setup and tested recognition speed for 10 different manipulation actions on 50 subjects. All objects were abstracted by emulated cubes so the actions could not be inferred using object information. Instead, subjects had to rely only on the information that comes from the changes in the spatial relations that occur between those cubes. In spite of these constraints, our results show the subjects were able to predict actions in, on average, less than 64% of the action's duration. We employed a computational model -an enriched Semantic Event Chain (eSEC)- incorporating the information of spatial relations, specifically (a) objects' touching/untouching, (b) static spatial relations between objects and (c) dynamic spatial relations between objects. Trained on the same actions as those observed by subjects, the model successfully predicted actions even better than humans. Information theoretical analysis shows that eSECs optimally use individual cues, whereas humans presumably mostly rely on a mixed-cue strategy, which takes longer until recognition. Providing a better cognitive basis of action recognition may, on one hand improve our understanding of related human pathologies and, on the other hand, also help to build robots for conflict-free human-robot cooperation. Our results open new avenues here.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑