arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.12950cs.CV
收藏

人机交互检测:方法的快速调查和检查

Human-Object Interaction Detection:A Quick Survey and Examination of Methods

University of Oregon(俄勒冈大学)

Trevor Bergstrom, Humphrey Shi

摘要:

人机交互检测是计算机视觉和视觉语义信息抽取领域的一个相对较新的课题。为了让机器识别人类在物体上执行的交互,该领域的研究有许多真实的用例。据我们所知,这是第一次对这一领域的最先进和里程碑式的工作进行全面调查。我们提供了一个基本的调查在人与物体交互检测领域的发展。该领域中的许多工作使用多流卷积神经网络架构,其将来自输入图像中的多个源的特征组合。最常见的是人和物体的问题,以及两者的空间质量。据我们所知,还没有进行过深入的研究,单独研究每个组件的性能。为了向未来的研究人员提供见解,我们进行了一项个性化的研究,该研究检查了多流卷积神经网络架构的每个组件的性能,用于人与物体的交互检测。具体来说,我们研究了HORCNN架构,因为它是该领域的基础工作。此外,我们还深入研究了HICO-DET数据集,这是人与物体交互检测领域的流行基准。代码和论文可以在https://github.com/SHI-Labs/Human-Object-Interaction-Detection上找到。

英文摘要:

Human-object interaction detection is a relatively new task in the world of computer vision and visual semantic information extraction. With the goal of machines identifying interactions that humans perform on objects, there are many real-world use cases for the research in this field. To our knowledge, this is the first general survey of the state-of-the-art and milestone works in this field. We provide a basic survey of the developments in the field of human-object interaction detection. Many works in this field use multi-stream convolutional neural network architectures, which combine features from multiple sources in the input image. Most commonly these are the humans and objects in question, as well as the spatial quality of the two. As far as we are aware, there have not been in-depth studies performed that look into the performance of each component individually. In order to provide insight to future researchers, we perform an individualized study that examines the performance of each component of a multi-stream convolutional neural network architecture for human-object interaction detection. Specifically, we examine the HORCNN architecture as it is a foundational work in the field. In addition, we provide an in-depth look at the HICO-DET dataset, a popular benchmark in the field of human-object interaction detection. Code and papers can be found at https://github.com/SHI-Labs/Human-Object-Interaction-Detection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑