arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.12499cs.CVcs.AIcs.LGcs.NE
收藏

跨域无监督Tagged-to-Cine MRI合成的生成式自训练

Generative Self-training for Cross-domain Unsupervised Tagged-to-Cine MRI Synthesis

Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);University of Maryland School of Dentistry(马里兰大学牙医学院);Johns Hopkins University(约翰斯·霍普金斯大学)

Xiaofeng Liu, Fangxu Xing, Maureen Stone, Jiachen Zhuo, Reese Timothy, Jerry L. Prince, Georges El Fakhri, Jonghye Woo

摘要:

基于自训练的无监督领域自适应(UDA)在将源域中的训练后的深度学习模型应用于未标记的目标域时,已经显示出解决域移位问题的巨大潜力。然而,虽然自训练UDA已经通过基于softmax离散直方图的可靠伪标签选择证明了其在区分任务(如分类和分割)上的有效性,但用于生成任务(如图像合成)的自训练UDA尚未得到充分研究。在这项工作中,我们提出了一种新的生成式自训练(GST)UDA框架,具有连续值预测和回归目标,用于跨域图像合成。具体来说,我们建议使用不确定性掩码过滤伪标签,并使用实际变分贝叶斯学习量化生成图像的预测置信度。快速测试时自适应是通过一个基于轮的替代优化方案。我们验证了我们的框架上的标记到电影磁共振成像(MRI)的合成问题,在源和目标域的数据集从不同的扫描仪或中心。进行了广泛的验证,以验证我们的框架对流行的对抗训练UDA方法。结果表明,与对抗训练UDA方法相比,我们的GST在新的目标域中标记了测试对象的MRI,大幅提高了合成质量。

英文摘要:

Self-training based unsupervised domain adaptation (UDA) has shown great potential to address the problem of domain shift, when applying a trained deep learning model in a source domain to unlabeled target domains. However, while the self-training UDA has demonstrated its effectiveness on discriminative tasks, such as classification and segmentation, via the reliable pseudo-label selection based on the softmax discrete histogram, the self-training UDA for generative tasks, such as image synthesis, is not fully investigated. In this work, we propose a novel generative self-training (GST) UDA framework with continuous value prediction and regression objective for cross-domain image synthesis. Specifically, we propose to filter the pseudo-label with an uncertainty mask, and quantify the predictive confidence of generated images with practical variational Bayes learning. The fast test-time adaptation is achieved by a round-based alternative optimization scheme. We validated our framework on the tagged-to-cine magnetic resonance imaging (MRI) synthesis problem, where datasets in the source and target domains were acquired from different scanners or centers. Extensive validations were carried out to verify our framework against popular adversarial training UDA methods. Results show that our GST, with tagged MRI of test subjects in new target domains, improved the synthesis quality by a large margin, compared with the adversarial training UDA methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑