arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.04847cs.LGeess.SP
收藏

在基于模型的架构中使用未训练神经网络解决模型失配的反问题

Solving Inverse Problems with Model Mismatch using Untrained Neural Networks within Model-based Architectures

Georgia Institute of Technology(佐治亚理工学院);King Fahd University of Petroleum and Minerals(法赫德国王石油矿产大学)

Peimeng Guan, Naveed Iqbal, Mark A. Davenport, Mudassir Masood

AI总结:

本文针对基于模型的深度学习方法中前向模型失配问题,提出在 LU 和 DEQ 架构中引入未训练的前向模型残差块,实现单次传递中同时拟合前向模型与重建,并在多个线性和非线性反问题实验中验证了其有效性和鲁棒性。

摘要:

基于模型的深度学习方法,如循环展开(LU)和深度均衡模型(DEQ)扩展,在求解反问题(IP)方面表现出卓越的性能。这些方法将优化迭代展开为一系列神经网络,实际上从数据中学习正则化函数。尽管这些架构目前在众多应用中处于最先进水平,但其成功严重依赖于前向模型的准确性。由于模型简化或设备不确定性,这一假设在许多物理应用中可能受到限制。为了解决前向模型失配问题,我们在基于模型的架构中引入了一个未训练的前向模型残差块,以在测量域中匹配每个实例的数据一致性。我们在两种著名的基于模型的架构(LU 和 DEQ)中提出了两种变体,并在温和条件下证明了收敛性。我们的方法提供了一种统一的解决方案,对参数不太敏感,不需要额外数据,并且能够在单次传递中同时拟合前向模型和进行重建,同时适用于线性和非线性反问题。实验表明,在涵盖线性和非线性反问题的三个不同应用中,该方法在去除伪影和保留细节方面均取得了显著的质量提升。此外,我们强调了中间步骤的重建有效性,并展示了残差块对随机初始化以及评估期间更多迭代次数的鲁棒性。代码可在 \ exttt{https://github.com/InvProbs/A-adaptive-model-based-methods} 获取。

英文摘要:

Model-based deep learning methods such as loop unrolling (LU) and deep equilibrium model}(DEQ) extensions offer outstanding performance in solving inverse problems (IP). These methods unroll the optimization iterations into a sequence of neural networks that in effect learn a regularization function from data. While these architectures are currently state-of-the-art in numerous applications, their success heavily relies on the accuracy of the forward model. This assumption can be limiting in many physical applications due to model simplifications or uncertainties in the apparatus. To address forward model mismatch, we introduce an untrained forward model residual block within the model-based architecture to match the data consistency in the measurement domain for each instance. We propose two variants in well-known model-based architectures (LU and DEQ) and prove convergence under mild conditions. Our approach offers a unified solution that is less parameter-sensitive, requires no additional data, and enables simultaneous fitting of the forward model and reconstruction in a single pass, benefiting both linear and nonlinear inverse problems. The experiments show significant quality improvement in removing artifacts and preserving details across three distinct applications, encompassing both linear and nonlinear inverse problems. Moreover, we highlight reconstruction effectiveness in intermediate steps and showcase robustness to random initialization of the residual block and a higher number of iterations during evaluation. Code is available at \texttt{https://github.com/InvProbs/A-adaptive-model-based-methods}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑