arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.09407cs.CV
收藏

医学影像和自然物体的单切片到三维重建:与SAM 3D的比较基准

Single-Slice-to-3D Reconstruction in Medical Imaging and Natural Objects: A Comparative Benchmark with SAM 3D

Harvard AI and Robotics Lab(哈佛人工智能与机器人实验室);Harvard University(哈佛大学)

Yan Luo, Advaith Ravishankar, Serena Liu, Yutong Yang, Mengyu Wang

AI总结:

本文通过比较基准揭示了单切片到三维重建的局限性,指出SAM3D在医学形状拓扑相似性上表现最佳,但需领域适应和解剖约束以克服复杂医学几何。

摘要:

尽管三维成像对临床诊断至关重要,但其高成本和长等待时间促使人们使用图像到三维基础模型来从二维模态推断体积。然而,由于这些模型是在自然图像上训练的,它们学习到的几何先验难以转移到本质上平面的医学数据。在六个医学和两个自然数据集上对五种最先进的模型(SAM3D、Hunyuan3D-2.1、Direct3D、Hi3DGen和TripoSG)进行的基准测试表明,由于单切片输入的严重深度模糊,基于体素的重叠在所有方法中始终保持极低水平。尽管这种体积推断的根本性失败,全局距离度量表明SAM3D最能捕捉到地面真实医学形状的拓扑相似性,而其他模型容易产生过度简化。最终,这些发现量化了零样本单切片三维推断的局限性,强调可靠的医学三维重建需要领域特定的适应和解剖学约束来克服复杂的医学几何结构。

英文摘要:

While three-dimensional imaging is essential for clinical diagnosis, its high cost and long wait times have motivated the use of image-to-3D foundation models to infer volume from two-dimensional modalities. However, because these models are trained on natural images, their learned geometric priors struggle to transfer to inherently planar medical data. A benchmark of five state-of-the-art models (SAM3D, Hunyuan3D-2.1, Direct3D, Hi3DGen, and TripoSG) across six medical and two natural datasets revealed that voxel-based overlap remains uniformly low across all methods due to severe depth ambiguity from single-slice inputs. Despite this fundamental volumetric failure, global distance metrics indicate that SAM3D best captures topological similarity to ground-truth medical shapes, whereas alternative models are prone to oversimplification. Ultimately, these findings quantify the limits of zero-shot single-slice 3D inference, highlighting that reliable medical 3D reconstruction requires domain-specific adaptation and anatomical constraints to overcome complex medical geometries.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑