arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1807.10889cs.CV
收藏

识别人-物交互的成对身体部位注意

Pairwise Body-Part Attention for Recognizing Human-Object Interactions

Shanghai Jiao Tong University(上海交通大学);Tencent YouTu Lab(腾讯优图实验室)

Hao-Shu Fang, Jinkun Cao, Yu-Wing Tai, Cewu Lu

摘要:

在人-物交互(HOI)识别中,传统的方法将人体视为一个整体,并对整个身体区域给予统一的关注。他们忽略了一个事实,即正常情况下,人类通过使用身体的某些部分与物体进行交互。本文认为,在HOI识别中,对不同的身体部位应给予不同的关注,并应进一步考虑不同身体部位之间的相关性。这是因为我们的身体部位总是协同工作。我们提出了一个新的成对身体部位注意力模型,它可以学习专注于关键部位,以及它们之间的相关性,用于HOI识别。该模型引入了一种新的基于注意力的特征选择方法和一种能够捕捉身体部位间成对相关性的特征表示方案。我们提出的方法在HIO数据集上的HOI识别中比最先进的结果提高了4%。我们将公开我们的模型和源代码。

英文摘要:

In human-object interactions (HOI) recognition, conventional methods consider the human body as a whole and pay a uniform attention to the entire body region. They ignore the fact that normally, human interacts with an object by using some parts of the body. In this paper, we argue that different body parts should be paid with different attention in HOI recognition, and the correlations between different body parts should be further considered. This is because our body parts always work collaboratively. We propose a new pairwise body-part attention model which can learn to focus on crucial parts, and their correlations for HOI recognition. A novel attention based feature selection method and a feature representation scheme that can capture pairwise correlations between body parts are introduced in the model. Our proposed approach achieved 4% improvement over the state-of-the-art results in HOI recognition on the HICO dataset. We will make our model and source codes publicly available.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑