arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.10641cs.CVcs.LG
收藏

用于3D逆问题中高效分布外(OOD)适配的深度扩散图像先验

Deep Diffusion Image Prior for Efficient OOD Adaptation in 3D Inverse Problems

KAIST(韩国科学技术院)

Hyungjin Chung, Jong Chul Ye

AI总结:

针对扩散先验逆问题的分布外适配需求,提出深度扩散图像先验框架及专为3D测量设计的高效D3IP方法,结合元学习可进一步提升性能,仅用体模图像训练的先验即可完成多种3D重建任务。

摘要:

近年来,利用生成式扩散先验的逆问题求解器凭借出色的重建质量受到广泛关注。然而,当训练分布与测试分布存在差异时,必须对先验进行适配。本文提出深度扩散图像先验(DDIP),该方法通过建立与深度图像先验(Deep Image Prior)的正式关联,对近期提出的SCD适配方法进行了推广。在此框架下,我们提出了一种专为3D测量设计的高效适配方法D3IP,它将DDIP的速度提升了数个数量级,同时实现了更优的性能。D3IP可与3D逆问题求解器无缝集成,从而得到连贯的3D重建结果。此外,我们证明元学习技术也可应用于该方法以进一步提升性能。实验表明,我们的方法能够仅用与训练集差异极大的体模图像训练的生成先验,完成多种3D重建任务,为在无法使用金标准数据训练的场景下应用扩散逆问题求解器开辟了新的可能。代码链接:https://github.com/HJ-harry/DDIP3D

英文摘要:

Recent inverse problem solvers that leverage generative diffusion priors have garnered significant attention due to their exceptional quality. However, adaptation of the prior is necessary when there exists a discrepancy between the training and testing distributions. In this work, we propose deep diffusion image prior (DDIP), which generalizes the recent adaptation method of SCD by introducing a formal connection to the deep image prior. Under this framework, we propose an efficient adaptation method dubbed D3IP, specified for 3D measurements, which accelerates DDIP by orders of magnitude while achieving superior performance. D3IP enables seamless integration of 3D inverse solvers and thus leads to coherent 3D reconstruction. Moreover, we show that meta-learning techniques can also be applied to yield even better performance. We show that our method is capable of solving diverse 3D reconstructive tasks from the generative prior trained only with phantom images that are vastly different from the training set, opening up new opportunities of applying diffusion inverse solvers even when training with gold standard data is impossible. Code: https://github.com/HJ-harry/DDIP3D

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑