arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2112.05752eess.IVcs.CV
收藏

基于特征保持的联邦学习MR图像重建

Specificity-Preserving Federated Learning for MR Image Reconstruction

Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));Institute of High Performance Computing, A*STAR(新加坡科技研究局高性能计算研究所);Shenzhen Institutes of Advanced Technology, CAS(中国科学院深圳先进技术研究院);Terminus Group(特斯联集团)

Chun-Mei Feng, Yunlu Yan, Shanshan Wang, Yong Xu, Ling Shao, Huazhu Fu

摘要:

联邦学习(FL)可用于通过使多个机构能够协作而无需聚合本地数据来提高磁共振(MR)图像重建中的数据隐私和效率。然而,由不同的MR成像协议所引起的域偏移会大大降低FL模型的性能。最近的FL技术倾向于通过增强全局模型的泛化来解决这个问题,但是它们忽略了特定于域的特征,这些特征可能包含关于设备属性的重要信息并且对于局部重建是有用的。本文提出了一种保持特异性的FL算法用于MR图像重建(FedMRI)。其核心思想是将MR重建模型分为两个部分:一个全局共享的编码器,以获得在全球范围内的广义表示,和一个客户端特定的解码器,以保持每个客户端的域特定的属性,这是很重要的协作重建时,客户端具有独特的分布。然后,这种方案分别在频率空间和图像空间中执行,允许在不同的空间中同时探索广义表示和客户端特定的属性。此外,为了在存在域偏移时进一步提高全局共享编码器的收敛性,引入加权对比正则化以直接校正优化期间客户端和服务器之间的任何偏差。大量的实验表明,我们的FedMRI的重建结果是最接近多机构数据的地面实况,并且它优于最先进的FL方法。

英文摘要:

Federated learning (FL) can be used to improve data privacy and efficiency in magnetic resonance (MR) image reconstruction by enabling multiple institutions to collaborate without needing to aggregate local data. However, the domain shift caused by different MR imaging protocols can substantially degrade the performance of FL models. Recent FL techniques tend to solve this by enhancing the generalization of the global model, but they ignore the domain-specific features, which may contain important information about the device properties and be useful for local reconstruction. In this paper, we propose a specificity-preserving FL algorithm for MR image reconstruction (FedMRI). The core idea is to divide the MR reconstruction model into two parts: a globally shared encoder to obtain a generalized representation at the global level, and a client-specific decoder to preserve the domain-specific properties of each client, which is important for collaborative reconstruction when the clients have unique distribution. Such scheme is then executed in the frequency space and the image space respectively, allowing exploration of generalized representation and client-specific properties simultaneously in different spaces. Moreover, to further boost the convergence of the globally shared encoder when a domain shift is present, a weighted contrastive regularization is introduced to directly correct any deviation between the client and server during optimization. Extensive experiments demonstrate that our FedMRI's reconstructed results are the closest to the ground-truth for multi-institutional data, and that it outperforms state-of-the-art FL methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑