arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.12254eess.IVcs.CV

通过3D到2D非配对扫描蒸馏增强单切片分割性能

Enhancing Single-Slice Segmentation with 3D-to-2D Unpaired Scan Distillation

Vanderbilt University(范德堡大学);Nivida Corporation(英伟达公司);National Institute on Aging(国家衰老研究所)
Xin Yu, Qi Yang, Han Liu, Ho Hin Lee, Yucheng Tang, Lucas W. Remedios, Michael E. Kim, Rendong Zhang, Shunxing Bao, Yuankai Huo, Ann Zenobia Moore, Luigi Ferruc… 展开作者

Xin Yu, Qi Yang, Han Liu, Ho Hin Lee, Yucheng Tang, Lucas W. Remedios, Michael E. Kim, Rendong Zhang, Shunxing Bao, Yuankai Huo, Ann Zenobia Moore, Luigi Ferrucci, Bennett A. Landman

AI总结:

针对2D单切片CT分割网络上下文捕获能力不足的问题,提出3D到2D非配对扫描蒸馏框架,用预训练3D模型的预测分布质心引导2D网络学习类间类内关联,在小数据场景下也能提升分割性能,减轻标注负担。

摘要:

2D单切片腹部计算机断层扫描(CT)能够以低辐射剂量评估体格状态与器官健康状况。然而,单切片数据需采用2D网络进行分割,但这类网络往往难以有效捕获上下文信息。因此,即便在完全相同的数据集上训练,3D网络通常也能取得更优的分割结果。本研究提出一种全新的3D到2D蒸馏框架,利用预训练3D模型提升2D单切片分割性能。具体而言,我们从3D表征中提取预测分布质心,通过引导2D学生网络学习类内与类间相关性实现知识迁移。与要求输入数据一致的传统知识蒸馏方法不同,本方法采用任意对比度的非配对3D CT扫描来指导2D学生模型。我们在单切片巴尔的摩衰老纵向研究(BLSA)数据集的707名受试者数据上开展实验,结果表明,当前最优的2D多器官分割方法均可从3D教师模型中获益,实现单切片多器官分割性能的提升。值得注意的是,本方法在小数据场景下展现出显著效果:仅使用200名训练受试者时,性能甚至优于使用全部可用训练受试者训练的模型。因此,本研究凸显了减轻人工标注负担的潜力。

英文摘要:

2D single-slice abdominal computed tomography (CT) enables the assessment of body habitus and organ health with low radiation exposure. However, single-slice data necessitates the use of 2D networks for segmentation, but these networks often struggle to capture contextual information effectively. Consequently, even when trained on identical datasets, 3D networks typically achieve superior segmentation results. In this work, we propose a novel 3D-to-2D distillation framework, leveraging pre-trained 3D models to enhance 2D single-slice segmentation. Specifically, we extract the prediction distribution centroid from the 3D representations, to guide the 2D student by learning intra- and inter-class correlation. Unlike traditional knowledge distillation methods that require the same data input, our approach employs unpaired 3D CT scans with any contrast to guide the 2D student model. Experiments conducted on 707 subjects from the single-slice Baltimore Longitudinal Study of Aging (BLSA) dataset demonstrate that state-of-the-art 2D multi-organ segmentation methods can benefit from the 3D teacher model, achieving enhanced performance in single-slice multi-organ segmentation. Notably, our approach demonstrates considerable efficacy in low-data regimes, outperforming the model trained with all available training subjects even when utilizing only 200 training subjects. Thus, this work underscores the potential to alleviate manual annotation burdens.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑