In this article we develop and analyze novel iterative regularization techniques for the solution of systems of nonlinear ill--posed operator equations. The basic idea consists in considering separately each equation of this system and incorporating a loping strategy. The first technique is a Kaczmarz-type method, equipped with a novel stopping criteria. The second method is obtained using an embedding strategy, and again a Kaczmarz-type approach. We prove well-posedness, stability and convergence of both methods.
For the Tikhonov regularization of ill-posed nonlinear operator equations, convergence is studied in a Hilbert scale setting. We include the case of oversmoothing penalty terms, which means that the exact solution does not belong to the domain of definition of the considered penalty functional. In this case, we try to close a gap in the present theory, where Hölder-type convergence rates results have been proven under corresponding source conditions, but assertions on norm convergence of regularized solutions without source conditions are completely missing. A result of the present work is to …
Tikhonov regularization involves minimizing the combination of a data discrepancy term and a regularizing term, and is the standard approach for solving inverse problems. The use of non-convex regularizers, such as those defined by trained neural networks, has been shown to be effective in many cases. However, finding global minimizers in non-convex situations can be challenging, making existing theory inapplicable. A recent development in regularization theory relaxes this requirement by providing convergence based on critical points instead of strict minimizers. This paper investigates conve…
In this paper, we study a fractional-order variant of the asymptotical regularization method, called {\it Fractional Asymptotical Regularization (FAR)}, for solving linear ill-posed operator equations in a Hilbert space setting. We assign the method to the general linear regularization schema and prove that under certain smoothness assumptions, FAR with fractional order in the range $(1,2)$ yields an acceleration with respect to comparable order optimal regularization methods. Based on the one-step Adams-Moulton method, a novel iterative regularization scheme is developed for the numerical rea…
We consider a regularization concept for the solution of ill--posed operator equations, where the operator is composed of a continuous and a discontinuous operator. A particular application is level set regularization, where we develop a novel concept of minimizers. The proposed level set regularization is capable of handling changing topologies. A functional analytic framework explaining the splitting of topologies is given. The asymptotic limit of the level set regularization method is an evolution process, which is implemented numerically and the quality of the proposed algorithm is demonst…
In this work, we investigate the regularized solutions and their finite element solutions to the inverse source problems governed by partial differential equations, and establish the stochastic convergence and optimal finite element convergence rates of these solutions, under pointwise measurement data with random noise. Unlike most existing regularization theories, the regularization error estimates are derived without any source conditions, while the error estimates of finite element solutions show their explicit dependence on the noise level, regularization parameter, mesh size, and time st…
In this paper, we consider the $α\| \cdot\|_{\ell_1}-β\| \cdot\|_{\ell_2}$ sparsity regularization with parameter $α\geqβ\geq0$ for nonlinear ill-posed inverse problems. We investigate the well-posedness of the regularization. Compared to the case where $α>β\geq0$, the results for the case $α=β\geq0$ are weaker due to the lack of coercivity and Radon-Riesz property of the regularization term. Under certain condition on the nonlinearity of $F$, we prove that every minimizer of $ α\| \cdot\|_{\ell_1}-β\| \cdot\|_{\ell_2}$ regularization is sparse. For the case $α>β\geq0$, if the exact solution i…
In this paper, we consider linear ill-posed problems in Hilbert spaces and their regularization via frame decompositions, which are generalizations of the singular-value decomposition. In particular, we prove convergence for a general class of continuous regularization methods and derive convergence rates under both a-priori and a-posteriori parameter choice rules. Furthermore, we apply our derived results to a standard tomography problem based on the Radon transform.
Recently, inverse problems have attracted more and more attention in computational mathematics and become increasingly important in engineering applications. After the discretization, many of inverse problems are reduced to linear systems. Due to the typical ill-posedness of inverse problems, the reduced linear systems are often ill-posed, especially when their scales are large. This brings great computational difficulty. Particularly, a small perturbation in the right side of an ill-posed linear system may cause a dramatical change in the solution. Therefore, regularization methods should be …
The present work aims at the application of finite element discretizations to a class of equilibrium problems involving moving constraints. Therefore, a Moreau--Yosida based regularization technique, controlled by a parameter, is discussed and, using a generalized $Γ$-convergence concept, a priori convergence results are derived. The latter technique is applied to the discretization of the regularized problems and is used to prove the convergence to the orginal equilibrium problem, when both -- regularization and discretization -- are imposed simultaneously. In addition, a primal-dual gap tech…
We deal with the shape reconstruction of inclusions in elastic bodies. For solving this inverse problem in practice, data fitting functionals are used. Those work better than the rigorous monotonicity methods from [5], but have no rigorously proven convergence theory. Therefore we show how the monotonicity methods can be converted into a regularization method for a data-fitting functional without losing the convergence properties of the monotonicity methods. This is a great advantage and a significant improvement over standard regularization techniques. In more detail, we introduce constraints…
Tikhonov regularization with square-norm penalty for linear forward operators has been studied extensively in the literature. However, the results on convergence theory are based on technical proofs and difficult to interpret. It is also often not clear how those results translate into the discrete, numerical setting. In this paper we present a new strategy to study the properties of a regularization method on the example of Tikhonov regularization. The technique is based on the observation that Tikhonov regularization approximates the unknown exact solution in the range of the adjoint of the …
Deep learning based reconstruction methods deliver outstanding results for solving inverse problems and are therefore becoming increasingly important. A recently invented class of learning-based reconstruction methods is the so-called NETT (for Network Tikhonov Regularization), which contains a trained neural network as regularizer in generalized Tikhonov regularization. The existing analysis of NETT considers fixed operator and fixed regularizer and analyzes the convergence as the noise level in the data approaches zero. In this paper, we extend the frameworks and analysis considerably to ref…
The present paper analyzes a spectral regularization of a time-reversed reaction-diffusion problem with globally and locally Lipschitz nonlinearities. This type of inverse and ill-posed problems arises in a variety of real-world applications concerning heat conduction and tumour source localization. In accordance with the weak solvability result for the forward problem, we focus on the inverse problem with high-order Sobolev-Gevrey smoothness and with Sobolev measurements. As expected from the well-known results for the linear case, we prove that this nonlinear spectral regularization possesse…
In part I we introduced modified Landweber-Kaczmarz methods and have established a convergence analysis. In the present work we investigate three applications: an inverse problem related to thermoacoustic tomography, a nonlinear inverse problem for semiconductor equations, and a nonlinear problem in Schlieren tomography. Each application is considered in the framework established in the previous part. The novel algorithms show robustness, stability, computational efficiency and high accuracy.
This paper describes and compares some structure preserving techniques for the solution of linear discrete ill-posed problems with the t-product. A new randomized tensor singular value decomposition (R-tSVD) with a t-product is presented for low tubal rank tensor approximations. Regularization of linear inverse problems by truncated tensor eigenvalue decomposition (T-tEVD), truncated tSVD (T-tSVD), randomized T-tSVD (RT-tSVD), t-product Golub-Kahan bidiagonalization (tGKB) process, and t-product Lanczos (t-Lanczos) process are considered. A solution method that is based on reusing tensor Krylo…
In this paper we consider the iteratively regularized Gauss-Newton method, where regularization is achieved by Ivanov regularization, i.e., by imposing a priori constraints on the solution. We propose an a posteriori choice of the regularization radius, based on an inexact Newton / discrepancy principle approach, prove convergence and convergence rates under a variational source condition as the noise level tends to zero, and provide an analysis of the discretization error. Our results are valid in general, possibly nonreflexive Banach spaces, including, e.g., $L^\infty$ as a preimage space. T…
We consider a modified Tikhonov-type functional for the solution of ill-posed nonlinear inverse problems. Motivated by applications in the field of production engineering, we allow small deviations in the solution, which are modeled through a tolerance measure in the regularization term of the functional. The existence, stability, and weak convergence of minimizers are proved for such a functional, as well as the convergence rates in the Bregman distance. We present an example for illustrating the effect of tolerances on the regularized solution and examine parameter choice rules for finding t…
This paper studies Tikhonov regularization for finitely smoothing operators in Banach spaces when the penalization enforces too much smoothness in the sense that the penalty term is not finite at the true solution. In a Hilbert space setting, Natterer (1984) showed with the help of spectral theory that optimal rates can be achieved in this situation. ('Oversmoothing does not harm.') For oversmoothing variational regularization in Banach spaces only very recently progress has been achieved in several papers on different settings, all of which construct families of smooth approximations to the t…
The truncated singular value decomposition may be used to find the solution of linear discrete ill-posed problems in conjunction with Tikhonov regularization and requires the estimation of a regularization parameter that balances between the sizes of the fit to data function and the regularization term. The unbiased predictive risk estimator is one suggested method for finding the regularization parameter when the noise in the measurements is normally distributed with known variance. In this paper we provide an algorithm using the unbiased predictive risk estimator that automatically finds bot…
Error Estimates for Arnoldo-Tikhonov Regularization for Ill-Posed Operator Equations
Institute for Industrial Mathematics, Kepler University（工业数学研究所，开普勒大学）；Johann Radon Institute for Computational and Applied Mathematics, Austrian Academy of Sciences（约翰·拉德纳计算与应用数学研究所，奥地利科学院）；Department of Mathematical Sciences, Kent State University（凯特州立大学数学科学系）
This paper provides a new regularization method which is particularly suitable for linear exponentially ill-posed problems. Under logarithmic source conditions (which have a natural interpretation in terms of Sobolev spaces in the aforementioned context), concepts of qualifications as well as order optimal rates of convergence are presented. Optimality results under general source conditions expressed in terms of index functions are also studied. Finally, numerical experiments on three test problems attest the better performance of the new method compared to the well known Tikhonov method in i…
Recently, a large number of efficient deep learning methods for solving inverse problems have been developed and show outstanding numerical performance. For these deep learning methods, however, a solid theoretical foundation in the form of reconstruction guarantees is missing. In contrast, for classical reconstruction methods, such as convex variational and frame-based regularization, theoretical convergence and convergence rate results are well established. In this paper, we introduce deep synthesis regularization (DESYRE) using neural networks as nonlinear synthesis operator bridging the ga…
