arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.08955eess.IVcs.CVcs.LG
收藏

Modality Bank: Learn multi-modality images across data centers without sharing medical data

Rutgers University(罗格斯大学);SenseBrain Research(SenseBrain研究院);National Heart Centre Singapore(新加坡国家心脏中心);Duke-National University Of Singapore(杜克-新加坡国立大学)

Qi Chang, Hui Qu, Zhennan Yan, Yunhe Gao, Lohendran Baskaran, Dimitris Metaxas

英文摘要:

Multi-modality images have been widely used and provide comprehensive information for medical image analysis. However, acquiring all modalities among all institutes is costly and often impossible in clinical settings. To leverage more comprehensive multi-modality information, we propose a privacy secured decentralized multi-modality adaptive learning architecture named ModalityBank. Our method could learn a set of effective domain-specific modulation parameters plugged into a common domain-agnostic network. We demonstrate by switching different sets of configurations, the generator could output high-quality images for a specific modality. Our method could also complete the missing modalities across all data centers, thus could be used for modality completion purposes. The downstream task trained from the synthesized multi-modality samples could achieve higher performance than learning from one real data center and achieve close-to-real performance compare with all real images.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑