arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.12541cs.CV
收藏

基于层次化局部视图的细粒度三维形状分类

Fine-Grained 3D Shape Classification with Hierarchical Part-View Attentions

Tsinghua University(清华大学);University of Maryland, College Park(马里兰大学帕克分校)

Xinhai Liu, Zhizhong Han, Yu-Shen Liu, Matthias Zwicker

摘要:

细粒度三维形状分类对于形状理解和分析具有重要意义,是一个具有挑战性的研究课题。然而,由于缺乏细粒度的三维形状基准,细粒度的三维形状分类的研究很少被探索。为了解决这个问题,我们首先引入了一个新的3D形状数据集(名为FG 3D数据集),该数据集具有细粒度的类标签,包括飞机,汽车和椅子三个类别。每个类别都由细粒度级别的几个子类别组成。根据我们在这个细粒度数据集下的实验,我们发现最先进的方法受到同一类别中子类别之间的小方差的限制。为了解决这个问题,我们进一步提出了一种新的细粒度的三维形状分类方法FG 3D-Net捕获细粒度的局部细节的三维形状从多个渲染视图。具体地说,我们首先训练一个区域建议网络(RPN),在一般语义部分检测的基准下检测多个视图中的一般语义部分。然后,我们设计了一个层次化的零件视图注意力聚合模块,通过聚合一般语义的零件特征来学习全局形状表示,从而保留了3D形状的局部细节。部分视图注意模块分层利用部分级和视图级的注意力,以增加我们的功能的可辨别性。部分级注意突出每个视图中的重要部分,而视图级注意突出同一对象的所有视图中的区别性视图。此外,我们还集成了一个递归神经网络(RNN)来捕获来自不同视点的序列视图之间的空间关系。在细粒度的3D形状数据集上的实验结果表明,该方法优于其他最先进的方法。

英文摘要:

Fine-grained 3D shape classification is important for shape understanding and analysis, which poses a challenging research problem. However, the studies on the fine-grained 3D shape classification have rarely been explored, due to the lack of fine-grained 3D shape benchmarks. To address this issue, we first introduce a new 3D shape dataset (named FG3D dataset) with fine-grained class labels, which consists of three categories including airplane, car and chair. Each category consists of several subcategories at a fine-grained level. According to our experiments under this fine-grained dataset, we find that state-of-the-art methods are significantly limited by the small variance among subcategories in the same category. To resolve this problem, we further propose a novel fine-grained 3D shape classification method named FG3D-Net to capture the fine-grained local details of 3D shapes from multiple rendered views. Specifically, we first train a Region Proposal Network (RPN) to detect the generally semantic parts inside multiple views under the benchmark of generally semantic part detection. Then, we design a hierarchical part-view attention aggregation module to learn a global shape representation by aggregating generally semantic part features, which preserves the local details of 3D shapes. The part-view attention module hierarchically leverages part-level and view-level attention to increase the discriminability of our features. The part-level attention highlights the important parts in each view while the view-level attention highlights the discriminative views among all the views of the same object. In addition, we integrate a Recurrent Neural Network (RNN) to capture the spatial relationships among sequential views from different viewpoints. Our results under the fine-grained 3D shape dataset show that our method outperforms other state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑