arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.15224cs.CVcs.AIcs.LG
收藏

用于多视图3D目标识别的深度模型:综述

Deep Models for Multi-View 3D Object Recognition: A Review

Mona Alzahrani, Muhammad Usman, Salma Kammoun, Saeed Anwar, Tarek Helmy

AI总结:

本文综述多视图3D目标识别的深度模型,系统梳理基于深度学习与Transformer的分类、检索方法、数据集、视图配置、融合策略及应用,并指出关键发现与未来方向。

摘要:

人类决策通常依赖来自多个视角或视图的视觉信息。相比之下,基于机器学习的目标识别只利用目标单张图像中的信息。然而,单张图像所传达的信息可能不足以支持准确决策,尤其是在复杂的识别问题中。因此,将多视图3D表示用于目标识别,迄今已在实现最先进性能方面展现出最具前景的结果。本综述全面涵盖了用于3D分类和检索任务的多视图3D目标识别方法的最新进展。具体而言,我们重点关注基于深度学习和基于Transformer的技术,因为它们得到了广泛应用并取得了最先进的性能。我们详细介绍了现有的基于深度学习和基于Transformer的多视图3D目标识别模型,包括最常用的3D数据集、相机配置与视图数量、视图选择策略、预训练CNN架构、融合策略,以及在3D分类和3D检索任务上的识别性能。此外,我们还考察了使用多视图分类的各类计算机视觉应用。最后,我们强调了发展多视图3D目标识别方法的关键发现和未来方向,以为读者提供对该领域的全面理解。

英文摘要:

Human decision-making often relies on visual information from multiple perspectives or views. In contrast, machine learning-based object recognition utilizes information from a single image of the object. However, the information conveyed by a single image may not be sufficient for accurate decision-making, particularly in complex recognition problems. The utilization of multi-view 3D representations for object recognition has thus far demonstrated the most promising results for achieving state-of-the-art performance. This review paper comprehensively covers recent progress in multi-view 3D object recognition methods for 3D classification and retrieval tasks. Specifically, we focus on deep learning-based and transformer-based techniques, as they are widely utilized and have achieved state-of-the-art performance. We provide detailed information about existing deep learning-based and transformer-based multi-view 3D object recognition models, including the most commonly used 3D datasets, camera configurations and number of views, view selection strategies, pre-trained CNN architectures, fusion strategies, and recognition performance on 3D classification and 3D retrieval tasks. Additionally, we examine various computer vision applications that use multi-view classification. Finally, we highlight key findings and future directions for developing multi-view 3D object recognition methods to provide readers with a comprehensive understanding of the field.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑