arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2309.04071eess.IVcs.CV
收藏

结合颅内测量增强用于全脑分割的分层 Transformer

Enhancing Hierarchical Transformers for Whole Brain Segmentation with Intracranial Measurements Integration

Vanderbilt University(范德堡大学);Nvidia Corporation(英伟达公司)

Xin Yu, Yucheng Tang, Qi Yang, Ho Hin Lee, Shunxing Bao, Yuankai Huo, Bennett A. Landman

AI总结:

本文增强分层 Transformer UNesT,通过多站点预训练与微调策略,实现全脑133类分割与TICV/PFV同时测量,在保持脑区分割性能的同时精确估计颅内体积。

摘要:

利用磁共振成像(MRI)进行全脑分割能够实现对大脑区域的非侵入性测量,包括颅内总体积(TICV)和后颅窝体积(PFV)。增强现有的全脑分割方法以纳入颅内测量,在脑结构分析中提供了更高的全面性。尽管具有潜力,但由于包含全脑和 TICV/PFV 标签的手工标注图谱有限,将深度学习技术应用于颅内测量的任务面临着数据可用性的限制。本文中,我们增强了分层 Transformer UNesT 用于全脑分割,以实现同时分割 133 类全脑和 TICV/PFV。为解决数据稀缺问题,该模型首先在来自 8 个不同站点的 4859 个 T1 加权(T1w)3D 体积上进行预训练。这些体积通过多图谱分割流程进行处理以生成标签,而 TICV/PFV 标签不可用。随后,模型使用来自 Open Access Series Imaging Studies(OASIS)的 45 个 T1w 3D 体积进行微调,其中 133 个全脑类别和 TICV/PFV 标签均可用。我们使用 Dice 相似系数(DSC)评估我们的方法。结果表明,我们的模型能够进行精确的 TICV/PFV 估计,同时将 132 个脑区域的性能保持在相当水平。代码和训练模型可在:https://github.com/MASILab/UNesT/tree/main/wholebrainSeg 获取。

英文摘要:

Whole brain segmentation with magnetic resonance imaging (MRI) enables the non-invasive measurement of brain regions, including total intracranial volume (TICV) and posterior fossa volume (PFV). Enhancing the existing whole brain segmentation methodology to incorporate intracranial measurements offers a heightened level of comprehensiveness in the analysis of brain structures. Despite its potential, the task of generalizing deep learning techniques for intracranial measurements faces data availability constraints due to limited manually annotated atlases encompassing whole brain and TICV/PFV labels. In this paper, we enhancing the hierarchical transformer UNesT for whole brain segmentation to achieve segmenting whole brain with 133 classes and TICV/PFV simultaneously. To address the problem of data scarcity, the model is first pretrained on 4859 T1-weighted (T1w) 3D volumes sourced from 8 different sites. These volumes are processed through a multi-atlas segmentation pipeline for label generation, while TICV/PFV labels are unavailable. Subsequently, the model is finetuned with 45 T1w 3D volumes from Open Access Series Imaging Studies (OASIS) where both 133 whole brain classes and TICV/PFV labels are available. We evaluate our method with Dice similarity coefficients(DSC). We show that our model is able to conduct precise TICV/PFV estimation while maintaining the 132 brain regions performance at a comparable level. Code and trained model are available at: https://github.com/MASILab/UNesT/tree/main/wholebrainSeg.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑