arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.04546cs.CV
收藏

用于功能性MRI鲁棒刚性切片到体积配准的自注意力模型

A self-attention model for robust rigid slice-to-volume registration of functional MRI

Technion – Israel Institute of Technology(以色列理工学院);Boston Children’s Hospital(波士顿儿童医院);Harvard Medical School(哈佛医学院)

Samah Khawaled, Simon K. Warfield, Moti Freiman

AI总结:

提出一种带自注意力机制的端到端fMRI切片到体积配准模型,通过逐切片像素评分提升抗输入不确定性能力,精度与速度均优于对比方法。

摘要:

功能性磁共振成像(fMRI)在神经科学中至关重要,可用于研究脑部疾病、监测治疗以及绘制脑功能图谱。然而,fMRI扫描期间的头部运动发生在切片采集的各次激发之间,可能导致畸变、分析偏倚,并且由于需要重复扫描而增加成本。因此,通过切片到体积配准(SVR)进行回顾性切片级运动校正至关重要。既往研究已使用基于深度学习(DL)的模型来处理SVR任务;但它们忽视了由输入切片堆叠产生的不确定性,也没有为每个切片分配权重或评分。在本研究中,我们提出一种端到端SVR模型,用于将2D fMRI切片与3D参考体积对齐,并引入自注意力机制以增强对输入数据变化和不确定性的鲁棒性。该模型使用独立的切片编码器和体积编码器,以及一个自注意力模块,为每个切片分配逐像素评分。我们在200幅图像上开展了评估实验,这些图像包含由测试集中27名受试者生成的合成刚性运动,数据来自公开可用的Healthy Brain Network(HBN)数据集。实验结果表明,与最先进的基于深度学习的方法相比,我们的模型在对齐精度方面取得了具有竞争力的性能(欧氏距离为0.93 mm,而对比方法为1.86 mm)。此外,与传统迭代方法相比,我们的方法表现出显著更快的配准速度(0.096秒对1.17秒)。我们的端到端SVR模型有助于在fMRI采集期间进行实时头部运动追踪,确保面对输入不确定性时的可靠性和鲁棒性。包含训练和评估内容的源代码将很快公开。

英文摘要:

Functional Magnetic Resonance Imaging (fMRI) is vital in neuroscience, enabling investigations into brain disorders, treatment monitoring, and brain function mapping. However, head motion during fMRI scans, occurring between shots of slice acquisition, can result in distortion, biased analyses, and increased costs due to the need for scan repetitions. Therefore, retrospective slice-level motion correction through slice-to-volume registration (SVR) is crucial. Previous studies have utilized deep learning (DL) based models to address the SVR task; however, they overlooked the uncertainty stemming from the input stack of slices and did not assign weighting or scoring to each slice. In this work, we introduce an end-to-end SVR model for aligning 2D fMRI slices with a 3D reference volume, incorporating a self-attention mechanism to enhance robustness against input data variations and uncertainties. It utilizes independent slice and volume encoders and a self-attention module to assign pixel-wise scores for each slice. We conducted evaluation experiments on 200 images involving synthetic rigid motion generated from 27 subjects belonging to the test set, from the publicly available Healthy Brain Network (HBN) dataset. Our experimental results demonstrate that our model achieves competitive performance in terms of alignment accuracy compared to state-of-the-art deep learning-based methods (Euclidean distance of $0.93$ [mm] vs. $1.86$ [mm]). Furthermore, our approach exhibits significantly faster registration speed compared to conventional iterative methods ($0.096$ sec. vs. $1.17$ sec.). Our end-to-end SVR model facilitates real-time head motion tracking during fMRI acquisition, ensuring reliability and robustness against uncertainties in inputs. source code, which includes the training and evaluations, will be available soon.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑