arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2010.10001cs.CV
收藏

基于上下文异构图网络的人机交互检测

Contextual Heterogeneous Graph Network for Human-Object Interaction Detection

Sun Yat-sen University(中山大学);Peng Cheng Laboratory(鹏城实验室)

Hai Wang, Wei-Shi Zheng, Ling Yingbiao

摘要:

人-物交互(HOI)检测是理解人类活动的重要任务。图形结构适用于表示场景中的HOI。由于人与物之间存在从属关系--人在HOI中扮演主观角色,物扮演客观角色,因此场景中的同质实体与异质实体之间的关系也不应该是等同的。然而,以往的图模型将人和对象看作是同一类节点,没有考虑不同实体之间的消息是不相等的。在这项工作中,我们解决这样的问题HOI任务提出了一个异构的图形网络,模型人类和对象作为不同类型的节点,并结合类内消息之间的同质节点和类间消息之间的异构节点。此外,利用基于类内上下文和类间上下文的图注意力机制来改进学习。在基准数据集V-COCO和HICO-DET上的大量实验表明,类内和类间信息在HOI检测中的重要性,验证了该方法的有效性。

英文摘要:

Human-object interaction(HOI) detection is an important task for understanding human activity. Graph structure is appropriate to denote the HOIs in the scene. Since there is an subordination between human and object---human play subjective role and object play objective role in HOI, the relations between homogeneous entities and heterogeneous entities in the scene should also not be equally the same. However, previous graph models regard human and object as the same kind of nodes and do not consider that the messages are not equally the same between different entities. In this work, we address such a problem for HOI task by proposing a heterogeneous graph network that models humans and objects as different kinds of nodes and incorporates intra-class messages between homogeneous nodes and inter-class messages between heterogeneous nodes. In addition, a graph attention mechanism based on the intra-class context and inter-class context is exploited to improve the learning. Extensive experiments on the benchmark datasets V-COCO and HICO-DET demonstrate that the intra-class and inter-class messages are very important in HOI detection and verify the effectiveness of our method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑