When an inverse problem is solved by a gradient-based optimization algorithm, the corresponding forward and adjoint problems, which are introduced to compute the gradient, can be also solved iteratively. The idea of iterating at the same time on the inverse problem unknown and on the forward and adjoint problem solutions yields the concept of one-shot inversion methods. We are especially interested in the case where the inner iterations for the direct and adjoint problems are incomplete, that is, stopped before achieving a high accuracy on their solutions. Here, we focus on general linear inverse problems and generic fixed-point iterations for the associated forward problem. We analyze variants of the so-called multi-step one-shot methods, in particular semi-implicit schemes with a regularization parameter. We establish sufficient conditions on the descent step for convergence, by studying the eigenvalues of the block matrix of the coupled iterations. Several numerical experiments are provided to illustrate the convergence of these methods in comparison with the classical gradient descent, where the forward and adjoint problems are solved exactly by a direct solver instead. We observe that very few inner iterations are enough to guarantee good convergence of the inversion algorithm, even in the presence of noisy data.
Convergence Analysis of Ensemble Kalman Inversion: The Linear, Noisy Case
Institute for Mathematics, University of Mannheim(曼海姆大学数学研究所);Department of Computing and Mathematical Sciences, California Institute of Technology(加州理工学院计算与数学科学系)
Convergent and efficient iteratively regularized contrast source inversion-type methods for inverse medium scattering problems
Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院);School of Mathematical Sciences, University of Chinese Academy of Sciences(中国科学院大学数学科学学院)
A New Look at the Ensemble Kalman Filter for Inverse Problems: Duality, Non-Asymptotic Analysis and Convergence Acceleration
Department of Aerospace Engineering & Engineering Mechanics, UT Austin(德克萨斯大学奥斯汀分校航空航天工程与应用力学系);Hildebrand Department of Petroleum and Geosystems Engineering(希尔布兰德石油与地质系统工程系);Oden Institute for Computational Engineering and Sciences, UT Austin(德克萨斯大学奥斯汀分校奥登计算工程与科学学院);Facebook research(Facebook 研究)