In part I we introduced modified Landweber-Kaczmarz methods and have established a convergence analysis. In the present work we investigate three applications: an inverse problem related to thermoacoustic tomography, a nonlinear inverse problem for semiconductor equations, and a nonlinear problem in Schlieren tomography. Each application is considered in the framework established in the previous part. The novel algorithms show robustness, stability, computational efficiency and high accuracy.
In this paper, we consider the $α\| \cdot\|_{\ell_1}-β\| \cdot\|_{\ell_2}$ sparsity regularization with parameter $α\geqβ\geq0$ for nonlinear ill-posed inverse problems. We investigate the well-posedness of the regularization. Compared to the case where $α>β\geq0$, the results for the case $α=β\geq0$ are weaker due to the lack of coercivity and Radon-Riesz property of the regularization term. Under certain condition on the nonlinearity of $F$, we prove that every minimizer of $ α\| \cdot\|_{\ell_1}-β\| \cdot\|_{\ell_2}$ regularization is sparse. For the case $α>β\geq0$, if the exact solution i…
In this paper, we study a fractional-order variant of the asymptotical regularization method, called {\it Fractional Asymptotical Regularization (FAR)}, for solving linear ill-posed operator equations in a Hilbert space setting. We assign the method to the general linear regularization schema and prove that under certain smoothness assumptions, FAR with fractional order in the range $(1,2)$ yields an acceleration with respect to comparable order optimal regularization methods. Based on the one-step Adams-Moulton method, a novel iterative regularization scheme is developed for the numerical rea…
Building on the well-known total-variation (TV), this paper develops a general regularization technique based on nonlinear isotropic diffusion (NID) for inverse problems with piecewise smooth solutions. The novelty of our approach is to be adaptive (we speak of A-NID) i.e. the regularization varies during the iterates in order to incorporate prior information on the edges, deal with the evolution of the reconstruction and circumvent the limitations due to the non-convexity of the proposed functionals. After a detailed analysis of the convergence and well-posedness of the method, this latter is…
We consider a regularization concept for the solution of ill--posed operator equations, where the operator is composed of a continuous and a discontinuous operator. A particular application is level set regularization, where we develop a novel concept of minimizers. The proposed level set regularization is capable of handling changing topologies. A functional analytic framework explaining the splitting of topologies is given. The asymptotic limit of the level set regularization method is an evolution process, which is implemented numerically and the quality of the proposed algorithm is demonst…
In this article we develop and analyze novel iterative regularization techniques for the solution of systems of nonlinear ill--posed operator equations. The basic idea consists in considering separately each equation of this system and incorporating a loping strategy. The first technique is a Kaczmarz-type method, equipped with a novel stopping criteria. The second method is obtained using an embedding strategy, and again a Kaczmarz-type approach. We prove well-posedness, stability and convergence of both methods.
For the Tikhonov regularization of ill-posed nonlinear operator equations, convergence is studied in a Hilbert scale setting. We include the case of oversmoothing penalty terms, which means that the exact solution does not belong to the domain of definition of the considered penalty functional. In this case, we try to close a gap in the present theory, where Hölder-type convergence rates results have been proven under corresponding source conditions, but assertions on norm convergence of regularized solutions without source conditions are completely missing. A result of the present work is to …
Recently, inverse problems have attracted more and more attention in computational mathematics and become increasingly important in engineering applications. After the discretization, many of inverse problems are reduced to linear systems. Due to the typical ill-posedness of inverse problems, the reduced linear systems are often ill-posed, especially when their scales are large. This brings great computational difficulty. Particularly, a small perturbation in the right side of an ill-posed linear system may cause a dramatical change in the solution. Therefore, regularization methods should be …
We present different regularizations and numerical methods for the nonlinear Schrödinger equation with singular nonlinearity (sNLSE) including the regularized Lie-Trotter time-splitting (LTTS) methods and regularized Lawson-type exponential integrator (LTEI) methods. Due to the blowup of the singular nonlinearity, i.e., $f(ρ)=ρ^α$ with a fixed exponent $α<0$ goes to infinity when $ρ\to 0^+$ ($ρ= |ψ|^2$ represents the density with $ψ$ being the complex-valued wave function or order parameter), there are significant difficulties in designing accurate and efficient numerical schemes to solve the …
This paper describes and compares some structure preserving techniques for the solution of linear discrete ill-posed problems with the t-product. A new randomized tensor singular value decomposition (R-tSVD) with a t-product is presented for low tubal rank tensor approximations. Regularization of linear inverse problems by truncated tensor eigenvalue decomposition (T-tEVD), truncated tSVD (T-tSVD), randomized T-tSVD (RT-tSVD), t-product Golub-Kahan bidiagonalization (tGKB) process, and t-product Lanczos (t-Lanczos) process are considered. A solution method that is based on reusing tensor Krylo…
In this paper we the formulation of inverse problems as constrained minimization problems and their iterative solution by gradient or Newton type. We carry out a convergence analysis in the sense of regularization methods and discuss applicability to the problem of identifying the spatially varying diffusivity in an elliptic PDE from different sets of observations. Among these is a novel hybrid imaging techology known as impedance acoustic tomography, for which we provide numerical experiments.
Error Estimates for Arnoldo-Tikhonov Regularization for Ill-Posed Operator Equations
Institute for Industrial Mathematics, Kepler University（工业数学研究所，开普勒大学）；Johann Radon Institute for Computational and Applied Mathematics, Austrian Academy of Sciences（约翰·拉德纳计算与应用数学研究所，奥地利科学院）；Department of Mathematical Sciences, Kent State University（凯特州立大学数学科学系）
In this paper, we develop an asymptotic expansion-regularization (AER) method for inverse source problems in two-dimensional nonlinear and nonstationary singularly perturbed partial differential equations (PDEs). The key idea of this approach is the use of the asymptotic-expansion theory, which allows us to determine the conditions for the existence and uniqueness of a solution to a given PDE with a sharp transition layer. As a by-product, we derive a simpler link equation between the source function and first-order asymptotic approximation of the measurable quantities, and based on that equat…
We develop a computationally efficient algorithm for the automatic regularization of nonlinear inverse problems based on the discrepancy principle. We formulate the problem as an equality constrained optimization problem, where the constraint is given by a least squares data fidelity term and expresses the discrepancy principle. The objective function is a convex regularization function that incorporates some prior knowledge, such as the total variation regularization function. Using the Jacobian matrix of the nonlinear forward model, we consider a sequence of quadratically constrained optimiz…
This paper provides a new regularization method which is particularly suitable for linear exponentially ill-posed problems. Under logarithmic source conditions (which have a natural interpretation in terms of Sobolev spaces in the aforementioned context), concepts of qualifications as well as order optimal rates of convergence are presented. Optimality results under general source conditions expressed in terms of index functions are also studied. Finally, numerical experiments on three test problems attest the better performance of the new method compared to the well known Tikhonov method in i…
In this article we investigate the connection between regularization theory for inverse problems and dynamic programming theory. This is done by developing two new regularization methods, based on dynamic programming techniques. The aim of these methods is to obtain stable approximations to the solution of linear inverse ill-posed problems. We follow two different approaches and derive a continuous and a discrete regularization method. Regularization properties for both methods are proved as well as rates of convergence. A numerical benchmark problem concerning integral operators with convolut…
Shallow neural network yields regularization for ill-posed inverse problems
School of Mathematics and Statistics, Beijing Institute of Technology（北京理工大学数学与统计学院）；MSU-BIT-SMBU Joint Research Center of Applied Mathematics, Shenzhen MSU-BIT University（深圳北理莫斯科大学应用数学联合研究中心）
Two-parameter regularization of ill-posed spherical pseudo-differential equations in the space of continuous functions
Guangdong Province Key Laboratory of Computational Science, Sun Yat-sen University（中山大学）；Johann Radon Institute for Computational and Applied Mathematics, Austrian Academy of Sciences（奥地利科学院约翰·拉顿计算与应用数学研究所）；School of Mathematics and Statistics, University of New South Wales（新南威尔士大学数学与统计学院）
In the present work, we discuss variational regularization for ill-posed nonlinear problems with focus on an oversmoothing penalty term. This means in our model that the searched-for solution of the considered nonlinear operator equation does not belong to the domain of definition of the penalty functional. In the past years, such variational regularization has been investigated comprehensively in Hilbert scales. Our present study tries to continue and to extend those investigations to Banach scales. This new study includes convergence rates results for a priori choices of the regularization p…
Regularization matrices for discrete ill-posed problems in several space-dimensions
University School（大学学校）；Geomathematics Key Laboratory of Sichuan, College of Management Science, Chengdu University of Technology（四川地球数学重点实验室，成都理工大学管理学院）；Department of Mathematics, SAPIENZA Università di Roma（罗马智慧大学数学系）；Department of Mathematical Sciences, Kent State University（肯特州立大学数理科学系）
The choice of a suitable regularization parameter is an important part of most regularization methods for inverse problems. In the absence of reliable estimates of the noise level, heuristic parameter choice rules can be used to accomplish this task. While they are already fairly well-understood and tested in the case of linear problems, not much is known about their behaviour for nonlinear problems and even less in the respective case of iterative regularization. Hence, in this paper, we numerically study the performance of some of these rules when used to determine a stopping index for Landw…
These lecture notes for a graduate class present the regularization theory for linear and nonlinear ill-posed operator equations in Hilbert spaces. Covered are the general framework of regularization methods and their analysis via spectral filters as well as the concrete examples of Tikhonov regularization, Landweber iteration, regularization by discretization for linear inverse problems. In the nonlinear setting, Tikhonov regularization and iterative regularization (Landweber, Levenberg-Marquardt, and iteratively regularized Gauß-Newton methods) are discussed. The necessary background from fu…
We consider a modified Tikhonov-type functional for the solution of ill-posed nonlinear inverse problems. Motivated by applications in the field of production engineering, we allow small deviations in the solution, which are modeled through a tolerance measure in the regularization term of the functional. The existence, stability, and weak convergence of minimizers are proved for such a functional, as well as the convergence rates in the Bregman distance. We present an example for illustrating the effect of tolerances on the regularized solution and examine parameter choice rules for finding t…
