arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.04009eess.IVcs.CV
收藏

从任务特定的异模态域移位数据集学习组织和脑病变的联合分割

Learning joint segmentation of tissues and brain lesions from task-specific hetero-modal domain-shifted datasets

King’s College London(伦敦国王学院);School of Biomedical Engineering & Imaging Sciences(生物医学工程与成像科学学院);King’s College Hospital NHS Foundation Trust(国王学院医院国民健康服务基金会信托);NVIDIA(英伟达);Dementia Research Centre, UCL Institute of Neurology, UCL(伦敦大学学院痴呆研究中心、伦敦大学学院神经学研究所、伦敦大学学院);Department of Medical Physics, UCL(伦敦大学学院医学物理系);Department of Neuroradiology(神经放射科);St. Thomas’ Hospital(圣托马斯医院)

Reuben Dorent, Thomas Booth, Wenqi Li, Carole H. Sudre, Sina Kafiabadi, Jorge Cardoso, Sebastien Ourselin, Tom Vercauteren

摘要:

来自多模态MRI的脑组织分割是许多神经成像分析管道的关键构建块。然而,已经建立的组织分割方法尚未被开发以应对由病理学(诸如白质病变或肿瘤)引起的大的解剖学变化,并且在这些情况下经常失败。与此同时,随着深度神经网络(DNN)的出现,大脑病变的分割已经显着成熟。然而,很少有现有的方法允许正常组织和脑病变的联合分割。为这样的联合任务开发DNN目前受到以下事实的阻碍:注释数据集通常仅解决一个特定任务,并且依赖于包括特定于任务的成像模式集的特定于任务的成像协议。在这项工作中,我们提出了一种新的方法来建立一个联合组织和病变分割模型,从聚合的特定任务的异模态域转移和部分注释的数据集。从一个变分制定的联合问题,我们展示了如何预期的风险可以分解和优化经验。我们利用风险的上限来处理跨数据集的异构成像模式。为了应对潜在的领域转移,我们整合并测试了基于数据增强、对抗性学习和伪健康生成的三种传统技术。对于每个单独的任务,我们的联合方法达到了与特定任务和完全监督模型相当的性能。所提出的框架进行评估两种不同类型的脑病变:白质病变和胶质瘤。在后一种情况下,缺乏一个联合地面实况定量评估的目的,我们提出并使用一种新的临床相关的定性评估方法。

英文摘要:

Brain tissue segmentation from multimodal MRI is a key building block of many neuroimaging analysis pipelines. Established tissue segmentation approaches have, however, not been developed to cope with large anatomical changes resulting from pathology, such as white matter lesions or tumours, and often fail in these cases. In the meantime, with the advent of deep neural networks (DNNs), segmentation of brain lesions has matured significantly. However, few existing approaches allow for the joint segmentation of normal tissue and brain lesions. Developing a DNN for such a joint task is currently hampered by the fact that annotated datasets typically address only one specific task and rely on task-specific imaging protocols including a task-specific set of imaging modalities. In this work, we propose a novel approach to build a joint tissue and lesion segmentation model from aggregated task-specific hetero-modal domain-shifted and partially-annotated datasets. Starting from a variational formulation of the joint problem, we show how the expected risk can be decomposed and optimised empirically. We exploit an upper bound of the risk to deal with heterogeneous imaging modalities across datasets. To deal with potential domain shift, we integrated and tested three conventional techniques based on data augmentation, adversarial learning and pseudo-healthy generation. For each individual task, our joint approach reaches comparable performance to task-specific and fully-supervised models. The proposed framework is assessed on two different types of brain lesions: White matter lesions and gliomas. In the latter case, lacking a joint ground-truth for quantitative assessment purposes, we propose and use a novel clinically-relevant qualitative assessment methodology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑