arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.17898cs.CVcs.AI
收藏

基于稀疏图注意力机制的卷积神经网络用于MRI超分辨率

Convolutional neural network based on sparse graph attention mechanism for MRI super-resolution

State Key Laboratory of Robotics Technology and Systems, Harbin Institute of Technology(哈尔滨工业大学机器人技术与系统国家重点实验室)

Xin Hua, Zhijiang Du, Hongjian Yu, Jixin Maa

AI总结:

本文提出一种结合多卷积算子特征提取、跨特征交互和稀疏图注意力机制的MRI超分辨率网络,通过建模像素间关系提升重建性能,实验证明其优于现有最先进方法。

摘要:

磁共振成像(MRI)是一种有价值的临床工具,用于显示解剖结构并辅助准确诊断。利用深度学习技术的医学图像超分辨率(SR)重建可以增强病灶分析,并帮助医生提高诊断效率和准确性。然而,现有基于深度学习的SR方法主要依赖卷积神经网络(CNNs),这固有地限制了这些模型的表达能力,因此难以发现不同图像特征之间的潜在关系。为克服这一局限,我们提出了一种A-network,该网络利用多个卷积算子特征提取模块(MCO)使用多个卷积算子提取图像特征。这些提取的特征通过多组交叉特征提取模块(MSC)进行处理,通过通道间特征交互突出关键特征,从而支持后续的特征学习。引入了一个基于注意力的稀疏图神经网络模块,用于建立像素特征之间的关系,学习哪些相邻像素对确定待填充特征的影响最大。为评估我们模型的有效性,我们使用不同模型在多个数据集生成的具有不同退化倍数的数据上进行了实验,实验结果表明,我们的方法相比当前最先进的方法有显著改进。

英文摘要:

Magnetic resonance imaging (MRI) is a valuable clinical tool for displaying anatomical structures and aiding in accurate diagnosis. Medical image super-resolution (SR) reconstruction using deep learning techniques can enhance lesion analysis and assist doctors in improving diagnostic efficiency and accuracy. However, existing deep learning-based SR methods predominantly rely on convolutional neural networks (CNNs), which inherently limit the expressive capabilities of these models and therefore make it challenging to discover potential relationships between different image features. To overcome this limitation, we propose an A-network that utilizes multiple convolution operator feature extraction modules (MCO) for extracting image features using multiple convolution operators. These extracted features are passed through multiple sets of cross-feature extraction modules (MSC) to highlight key features through inter-channel feature interactions, enabling subsequent feature learning. An attention-based sparse graph neural network module is incorporated to establish relationships between pixel features, learning which adjacent pixels have the greatest impact on determining the features to be filled. To evaluate our model's effectiveness, we conducted experiments using different models on data generated from multiple datasets with different degradation multiples, and the experimental results show that our method is a significant improvement over the current state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑