arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2607.00522cs.CV
收藏

Restore3D:通过形状和纹理修复为破损物体注入生机

Restore3D: Breathing Life into Broken Objects with Shape and Texture Restoration

ReLER, CCAI, Zhejiang University(ReLER、CCAI、浙江大学)

Xiaolong Shen, Zongxin Yang, Yi Yang

AI总结:

提出Restore3D框架,利用多视图图像同时修复破损物体的几何形状和纹理,通过自动数据生成、掩码自感知模块和深度感知掩码修正器生成高分辨率多视图图像,再经粗到细重建获得带纹理的3D网格。

摘要:

修复不完整或受损的3D物体对于文化遗产保护、遮挡物体重建和艺术设计至关重要。现有方法主要关注几何补全,往往忽略纹理修复,并且难以处理相对复杂和多样的物体。我们提出Restore3D,一种新颖的框架,利用多视图图像同时修复破损物体的形状和纹理。为了解决训练数据有限的问题,我们开发了一个自动数据生成流程,从大规模3D数据集中合成配对的残缺-完整样本。Restore3D的核心是一个多视图模型,通过精心设计的带有深度感知掩码修正器的掩码自感知模块进行增强。自感知器学习到的修正掩码引导图像集成与增强阶段,帮助保留观察到的形状和纹理模式,同时细化生成区域并缓解基础模型的低分辨率限制,从而生成高分辨率、语义一致且视图一致的多视图图像。然后采用粗到细的重建策略,从细化的多视图图像中恢复细节丰富的纹理3D网格。在合成和真实破损物体基准上的实验表明,在评估设置中,Restore3D在代表性修复、补全和重建基线方法上,提高了多视图修复质量和纹理网格重建效果。项目页面:this http URL

英文摘要:

Restoring incomplete or damaged 3D objects is crucial for cultural heritage preservation, occluded object reconstruction, and artistic design. Existing methods primarily focus on geometric completion, often neglecting texture restoration and struggling with relatively complex and diverse objects. We introduce Restore3D, a novel framework that simultaneously restores both the shape and texture of broken objects using multi-view images. To address limited training data, we develop an automated data generation pipeline that synthesizes paired incomplete-complete samples from large-scale 3D datasets. Central to Restore3D is a multi-view model, enhanced by a carefully designed Mask Self-Perceiver module with a Depth-Aware Mask Rectifier. The rectified masks learned by the self-perceiver guide an image integration and enhancement phase, helping retain observed shape and texture patterns while refining the generated regions and mitigating the low-resolution limitations of the base model, yielding high-resolution, semantically coherent, and view-consistent multi-view images. A coarse-to-fine reconstruction strategy is then employed to recover detailed textured 3D meshes from refined multi-view images. Experiments on synthetic and real broken-object benchmarks show that Restore3D improves multi-view restoration quality and textured-mesh reconstruction over representative inpainting, completion, and reconstruction baselines in the evaluated settings. Project Page: restore3dx.github.io

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑