arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.15433eess.IV
收藏

空间划分增强占用场用于双平面X射线骨骼形状重建

Spatial-Division Augmented Occupancy Field for Bone Shape Reconstruction from Biplanar X-Rays

Jixiang Chen, Yiqun Lin, Haoran Sun, Xiaomeng Li

AI总结:

针对双平面X射线骨骼重建中体素表示内存密集和忽视遮挡的问题,提出SdAOF,采用连续占用场和空间划分增强蒸馏,实现高效精细重建并超越现有方法。

摘要:

从双平面X射线图像中恢复3D骨骼解剖结构至关重要,因为与传统基于CT的方法相比,它可以显著减少辐射暴露。尽管已经提出了各种深度学习模型来解决这一复杂任务,但它们存在两个局限性:1)它们采用体素表示骨骼形状,并利用3D卷积层来捕获解剖先验,这需要大量内存并限制了重建分辨率。2)它们忽视了X射线图像中普遍存在的遮挡效应,并使用简单的损失直接提取特征,难以充分利用复杂的X射线信息。为了解决这些问题,我们提出了空间划分增强占用场(SdAOF)。SdAOF采用连续占用场进行形状表示,将重建问题重新表述为逐点占用值预测任务。其隐式和连续的特性使得训练时内存高效,并在推理时能够以不同分辨率进行精细尺度的表面重建。此外,我们提出了一种新颖的空间划分增强蒸馏策略,以提供特征级指导来捕获遮挡关系。在骨盆重建数据集上的大量实验表明,SdAOF优于最先进的方法,并重建出精细尺度的骨骼表面。代码可在https://github.com/xmed-lab/SdAOF获取。

英文摘要:

Retrieving 3D bone anatomy from biplanar X-ray images is crucial since it can significantly reduce radiation exposure compared to traditional CT-based methods. Although various deep learning models have been proposed to address this complex task, they suffer from two limitations: 1) They employ voxel representation for bone shape and exploit 3D convolutional layers to capture anatomy prior, which are memory-intensive and limit the reconstruction resolution. 2) They overlook the prevalent occlusion effect within X-ray images and directly extract features using a simple loss, which struggles to fully exploit complex X-ray information. To tackle these concerns, we present Spatial-division Augmented Occupancy Field~(SdAOF). SdAOF adopts the continuous occupancy field for shape representation, reformulating the reconstruction problem as a per-point occupancy value prediction task. Its implicit and continuous nature enables memory-efficient training and fine-scale surface reconstruction at different resolutions during the inference. Moreover, we propose a novel spatial-division augmented distillation strategy to provide feature-level guidance for capturing the occlusion relationship. Extensive experiments on the pelvis reconstruction dataset show that SdAOF outperforms state-of-the-art methods and reconstructs fine-scale bone surfaces.The code is available at https://github.com/xmed-lab/SdAOF

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑