arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.09995cs.CVcs.LGeess.IV
收藏

学习局部邻域结构的鲁棒三维形状表示

Learning Local Neighboring Structure for Robust 3D Shape Representation

MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University(上海交通大学人工智能研究院教育部人工智能重点实验室);Institute of Image Communication and Network Engineering, Shanghai Jiao Tong University(上海交通大学图像通信与网络工程研究所);School of Mathematical Sciences, University of Science and Technology of China(中国科学技术大学数学科学学院)

Zhongpai Gao, Junchi Yan, Guangtao Zhai, Juyong Zhang, Yiyan Yang, Xiaokang Yang

摘要:

网格是一种功能强大的三维形状数据结构。三维网格的表示学习在许多计算机视觉和图形学应用中是重要的。用于结构化数据的卷积神经网络(CNN)最近的成功(例如,图像)表明了将来自CNN的洞察力适应于3D形状的价值。然而,3D形状数据是不规则的,因为每个节点的邻居是无序的。已经开发了各种用于3D形状的图神经网络,其具有各向同性滤波器或预定义的局部坐标系以克服图上的节点不一致性。然而,各向同性滤波器或预定义的局部坐标系限制了表示能力。在本文中,我们提出了一种局部结构感知各向异性卷积运算(LSA-Conv),它根据局部相邻结构为每个节点学习自适应加权矩阵,并执行共享各向异性滤波器。事实上,可学习的加权矩阵类似于随机合成器中的注意力矩阵--一种用于自然语言处理(NLP)的新的Transformer模型。综合实验表明,我们的模型产生了显着的改善,在3D形状重建相比,国家的最先进的方法。

英文摘要:

Mesh is a powerful data structure for 3D shapes. Representation learning for 3D meshes is important in many computer vision and graphics applications. The recent success of convolutional neural networks (CNNs) for structured data (e.g., images) suggests the value of adapting insight from CNN for 3D shapes. However, 3D shape data are irregular since each node's neighbors are unordered. Various graph neural networks for 3D shapes have been developed with isotropic filters or predefined local coordinate systems to overcome the node inconsistency on graphs. However, isotropic filters or predefined local coordinate systems limit the representation power. In this paper, we propose a local structure-aware anisotropic convolutional operation (LSA-Conv) that learns adaptive weighting matrices for each node according to the local neighboring structure and performs shared anisotropic filters. In fact, the learnable weighting matrix is similar to the attention matrix in the random synthesizer -- a new Transformer model for natural language processing (NLP). Comprehensive experiments demonstrate that our model produces significant improvement in 3D shape reconstruction compared to state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑