arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.03359eess.IVcs.CV

SuperFormer:用于MRI超分辨率的体积Transformer架构

SuperFormer: Volumetric Transformer Architectures for MRI Super-Resolution

Center for Research and Formation in Artificial Intelligence(人工智能研究与培训中心);Universidad de los Andes(安第斯大学)

Cristhian Forigua, Maria Escobar, Pablo Arbelaez

AI总结:

本文提出SuperFormer,将Swin Transformer扩展到3D医学领域,利用3D相对位置编码的局部自注意力和多域信息融合实现MRI超分辨率,并在Human Connectome Project数据集上验证其优于3D CNN方法。

摘要:

本文提出了一种利用视觉Transformer(ViTs)处理体积医学信息的新框架。首先,我们将最先进的Swin Transformer模型扩展到3D医学领域。其次,我们提出了一种在ViTs中处理体积信息并为3D应用编码位置的新方法。我们实例化了所提出的框架,并提出了SuperFormer,这是一种基于体积Transformer的磁共振成像(MRI)超分辨率方法。我们的方法利用MRI领域的3D信息,并使用带有3D相对位置编码的局部自注意力机制来恢复解剖细节。此外,我们的方法利用来自体积域和特征域的多域信息,并将它们融合以重建高分辨率MRI。我们在Human Connectome Project数据集上进行了广泛验证,证明了体积Transformer相对于基于3D CNN的方法的优越性。我们的代码和预训练模型可在https://github.com/BCV-Uniandes/SuperFormer获取。

英文摘要:

This paper presents a novel framework for processing volumetric medical information using Visual Transformers (ViTs). First, We extend the state-of-the-art Swin Transformer model to the 3D medical domain. Second, we propose a new approach for processing volumetric information and encoding position in ViTs for 3D applications. We instantiate the proposed framework and present SuperFormer, a volumetric transformer-based approach for Magnetic Resonance Imaging (MRI) Super-Resolution. Our method leverages the 3D information of the MRI domain and uses a local self-attention mechanism with a 3D relative positional encoding to recover anatomical details. In addition, our approach takes advantage of multi-domain information from volume and feature domains and fuses them to reconstruct the High-Resolution MRI. We perform an extensive validation on the Human Connectome Project dataset and demonstrate the superiority of volumetric transformers over 3D CNN-based methods. Our code and pretrained models are available at https://github.com/BCV-Uniandes/SuperFormer.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑