arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2006.07981cs.CV
收藏

Geodrix-HOF:无切角的3D重建

Geodesic-HOF: 3D Reconstruction Without Cutting Corners

Samsung AI Center(三星人工智能中心)

Ziyun Wang, Eric A. Mitchell, Volkan Isler, Daniel D. Lee

摘要:

由于自然界中物体形态的多样性,单视点三维物体重建是计算机视觉中一个具有挑战性的基本问题。特别是,仅使用基于集合的损失函数训练的方法并不总是有效地捕获高曲率区域,从而导致重建表面短路或切角。特别是,仅使用基于集合的损失函数训练的方法并不总是有效地捕获高曲率区域,从而导致重建表面短路或切角。为了解决这个问题,我们建议学习一个图像条件的映射函数从一个典型的采样域到一个高维空间,其中欧几里得距离等于物体上的测地线距离。映射样本的前三个维度对应于其3D坐标。额外的提升组件包含有关基础测地线结构的信息。我们的研究结果表明,利用这些学习提升坐标产生更好的性能,估计表面法线和生成表面比单独使用点云重建。此外,我们发现这种学习的测地线嵌入空间为无监督对象分解等应用提供了有用的信息。

英文摘要:

Single-view 3D object reconstruction is a challenging fundamental problem in computer vision, largely due to the morphological diversity of objects in the natural world. In particular, high curvature regions are not always captured effectively by methods trained using only set-based loss functions, resulting in reconstructions short-circuiting the surface or cutting corners. In particular, high curvature regions are not always captured effectively by methods trained using only set-based loss functions, resulting in reconstructions short-circuiting the surface or cutting corners. To address this issue, we propose learning an image-conditioned mapping function from a canonical sampling domain to a high dimensional space where the Euclidean distance is equal to the geodesic distance on the object. The first three dimensions of a mapped sample correspond to its 3D coordinates. The additional lifted components contain information about the underlying geodesic structure. Our results show that taking advantage of these learned lifted coordinates yields better performance for estimating surface normals and generating surfaces than using point cloud reconstructions alone. Further, we find that this learned geodesic embedding space provides useful information for applications such as unsupervised object decomposition.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑