PuzzleFusion++:基于去噪与验证的自动凝聚式3D断裂碎片拼接
PuzzleFusion++: Auto-agglomerative 3D Fracture Assembly by Denoise and Verify
AI总结:
本研究提出自动凝聚式3D断裂拼接方法PuzzleFusion++,结合扩散模型去噪对齐参数与Transformer验证合并的迭代流程,在Breaking Bad数据集上多项指标大幅超越现有最优技术。
摘要:
本文提出了一种新颖的“自动凝聚式”3D断裂碎片拼接方法PuzzleFusion++,其思路类似人类解决高难度空间拼图的过程。该方法从单个碎片出发,1)对齐并合并碎片为更大的组,过程类似于凝聚式聚类;2)迭代重复该过程以完成拼接,机制类似于自回归方法。具体而言,扩散模型同时对碎片的6自由度(6-DoF)对齐参数进行去噪,Transformer模型验证成对对齐结果并将其合并为更大的对齐组,该过程迭代重复。在Breaking Bad数据集上的大量实验表明,PuzzleFusion++在所有指标上均以显著优势优于其他所有现有最优技术,尤其是零件准确率提升超过10%,Chamfer距离指标提升达50%。代码将在我们的项目页面发布:https://puzzlefusion-plusplus.github.io。
英文摘要:
This paper proposes a novel "auto-agglomerative" 3D fracture assembly method, PuzzleFusion++, resembling how humans solve challenging spatial puzzles. Starting from individual fragments, the approach 1) aligns and merges fragments into larger groups akin to agglomerative clustering and 2) repeats the process iteratively in completing the assembly akin to auto-regressive methods. Concretely, a diffusion model denoises the 6-DoF alignment parameters of the fragments simultaneously, and a transformer model verifies and merges pairwise alignments into larger ones, whose process repeats iteratively. Extensive experiments on the Breaking Bad dataset show that PuzzleFusion++ outperforms all other state-of-the-art techniques by significant margins across all metrics, in particular by over 10% in part accuracy and 50% in Chamfer distance. The code will be available on our project page: https://puzzlefusion-plusplus.github.io.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。