arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2012.11211eess.IVcs.CV
收藏

一个多视图动态融合框架:如何从多视图中改进多模态脑肿瘤分割?

A Multi-View Dynamic Fusion Framework: How to Improve the Multimodal Brain Tumor Segmentation from Multi-Views?

University of Electronic Science and Technology of China(电子科技大学);Institute of Electronic and Information Engineering of UESTC in Guangdong(电子科技大学广东电子信息工程研究院)

Yi Ding, Wei Zheng, Guozheng Wu, Ji Geng, Mingsheng Cao, Zhiguang Qin

摘要:

在诊断脑肿瘤时,医生通常通过分别从轴向视图、冠状视图和矢状视图观察多模态脑图像来做出诊断。然后他们根据从多个视图获得的信息做出综合决策以确认脑肿瘤。受这一诊断过程的启发,为了进一步利用数据集中隐藏的3D信息,本文提出了一种多视图动态融合框架,以提高脑肿瘤分割的性能。所提出的框架包括:1)多视图深度神经网络架构,其表示用于从不同视图分割脑肿瘤的多个学习网络,并且每个深度神经网络对应于来自单个视图的多模态脑图像;以及2)动态决策融合方法,其主要用于将来自多个视图的分割结果融合为集成的一种和两种不同的融合方法,采用投票法和加权平均法对熔制过程进行了评价。此外,提出了由分割损失、过渡损失和决策损失组成的多视图融合损失,以便于多视图学习网络的训练过程,从而使融合分割结果的过程和学习网络的训练过程保持外观和空间的一致性。\par通过在BRATS 2015和BRATS 2018上对所提出的框架进行评估,可以发现多视图的融合结果比单视图的分割结果具有更好的性能,并且所提出的多视图融合损失的有效性也得到了证明。此外,该框架实现了更好的分割性能和更高的效率相比,其他同行的方法。

英文摘要:

When diagnosing the brain tumor, doctors usually make a diagnosis by observing multimodal brain images from the axial view, the coronal view and the sagittal view, respectively. And then they make a comprehensive decision to confirm the brain tumor based on the information obtained from multi-views. Inspired by this diagnosing process and in order to further utilize the 3D information hidden in the dataset, this paper proposes a multi-view dynamic fusion framework to improve the performance of brain tumor segmentation. The proposed framework consists of 1) a multi-view deep neural network architecture, which represents multi learning networks for segmenting the brain tumor from different views and each deep neural network corresponds to multi-modal brain images from one single view and 2) the dynamic decision fusion method, which is mainly used to fuse segmentation results from multi-views as an integrate one and two different fusion methods, the voting method and the weighted averaging method, have been adopted to evaluate the fusing process. Moreover, the multi-view fusion loss, which consists of the segmentation loss, the transition loss and the decision loss, is proposed to facilitate the training process of multi-view learning networks so as to keep the consistency of appearance and space, not only in the process of fusing segmentation results, but also in the process of training the learning network. \par By evaluating the proposed framework on BRATS 2015 and BRATS 2018, it can be found that the fusion results from multi-views achieve a better performance than the segmentation result from the single view and the effectiveness of proposed multi-view fusion loss has also been proved. Moreover, the proposed framework achieves a better segmentation performance and a higher efficiency compared to other counterpart methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑