This paper mainly studies the quadratic growth and the strong metric subregularity of the subdifferential of a function that can be represented as the sum of a function twice differentiable in the extended sense and a subdifferentially continuous, prox-regular, twice epi-differentiable function. For such a function, which is not necessarily prox-regular, it is shown that the quadratic growth, the strong metric subregularity of the subdifferential at a local minimizer, and the positive definiteness of the subgradient graphical derivative at a stationary point are equivalent. In addition, other characterizations of the quadratic growth and the strong metric subregularity of the subdifferential are also given. Besides, properties of functions twice differentiable in the extended sense are examined.
For a proper extended real-valued function, this work focuses on the relationship between the subregularity of its subdifferential mapping relative to the critical set and its KL property of exponent 1/2. When the function is lsc convex, we establish the equivalence between them under the continuous assumption on the critical set. Then, for the uniformly prox-regular function, under its continuity on the local minimum set, the KL property of exponent 1/2 on the local minimum set is shown to be equivalent to the subregularity of its subdifferential relative to this set. Moreover, for this class…
In [2] we characterized in terms of a quadratic growth condition various metric regularity properties of the subdifferential of a lower semicontinuous convex function acting in a Hilbert space. Motivated by some recent results in [16] where the authors extend to Banach spaces the characterization of the strong regularity, we extend as well the characterizations for the metric subregularity and the strong subregularity given in [2] to Banach spaces. We also notice that at least one implication in these characterizations remains valid for the limiting subdifferential without assuming convexity o…
Necessary and sufficient criteria for metric subregularity (or calmness) of set-valued mappings between general metric or Banach spaces are treated in the framework of the theory of error bounds for a special family of extended real-valued functions of two variables. A classification scheme for the general error bound and metric subregularity criteria is presented. The criteria are formulated in terms of several kinds of primal and subdifferential slopes.
The Holder setting of the metric subregularity property of set-valued mappings between general metric or Banach/Asplund spaces is investigated in the framework of the theory of error bounds for extended real-valued functions of two variables. A classification scheme for the general Holder metric subregularity criteria is presented. The criteria are formulated in terms of several kinds of primal and subdifferential slopes.
This paper sheds new light on several interrelated topics of second-order variational analysis, both in finite and infinite-dimensional settings. We establish new relationships between second-order growth conditions on functions, the basic properties of metric regularity and subregularity of the limiting subdifferential, tilt-stability of local minimizers, and positive-definiteness/semidefiniteness properties of the second-order subdifferential (or generalized Hessian).
Based on the needs of convergence proofs of preconditioned proximal point methods, we introduce notions of partial strong submonotonicity and partial (metric) subregularity of set-valued maps. We study relationships between these two concepts, neither of which is generally weaker or stronger than the other one. For our algorithmic purposes, the novel submonotonicity turns out to be easier to employ than more conventional error bounds obtained from subregularity. Using strong submonotonicity, we demonstrate the linear convergence of the Primal-Dual Proximal splitting method to some strictly com…
We show that quadratic growth of a semi-algebraic function is equivalent to strong metric subregularity of the subdifferential --- a kind of stability of generalized critical points. In contrast, this equivalence can easily fail outside of the semi-algebraic setting. As a consequence, we derive necessary conditions and sufficient conditions for optimality in subdifferential terms.
We propose a level proximal subdifferential for a proper lower semicontinuous function. Level proximal subdifferential is a uniform refinement of the well-known proximal subdifferential, and has the pleasant feature that its resolvent always coincides with the proximal mapping of a function. It turns out that the resolvent representation of proximal mapping in terms of Mordukhovich limiting subdifferential is only valid for hypoconvex functions. We also provide properties of level proximal subdifferential and numerous examples to illustrate our results.
We provide a new proof that the subdifferential of a proper lower semicontinuous convex function on a Banach space is maximal monotone by adapting the pattern commonly used in the Hilbert setting. We then extend the arguments to show more precisely that subdifferentials of proper lower semicontinuous prox-bounded functions possess the Brøndsted-Rockafellar property.
Primal-Dual Error Bounds and KKT Metric Subregularity in Convex Composite Optimization
School of Mathematics and Statistics, Beijing Institute of Technology（北京理工大学数学与统计学院）；Beijing Key Laboratory on MCAACI/Key Laboratory of Mathematical Theory and Computation in Information Security, Beijing Institute of Technology（北京理工大学计算机辅助设计与图形学北京市重点实验室/信息安全数学理论与计算北京市重点实验室）
In this paper, we first study nonsmooth steepest descent method for nonsmooth functions defined on Hilbert space and establish the corresponding algorithm by proximal subgradients. Then, we use this algorithm to find stationary points for those functions satisfying prox-regularity and Lipschitzian continuity. As one application, the established algorithm is used to search the minimizer of lower semicontinuous and convex functions on finite-dimensional space. The convergent theorem, as one extension and improvement of the existing converging result for twice continuously differentiable convex f…
This paper proposes and develops a new Newton-type algorithm to solve subdifferential inclusions defined by subgradients of extended-real-valued prox-regular functions. The proposed algorithm is formulated in terms of the second-order subdifferential of such functions that enjoys extensive calculus rules and can be efficiently computed for broad classes of extended-real-valued functions. Based on this and on metric regularity and subregularity properties of subgradient mappings, we establish verifiable conditions ensuring well-posedness of the proposed algorithm and its local superlinear conve…
In this paper, we provide two types of sufficient conditions for ensuring the quadratic growth conditions of a class of constrained convex symmetric and non-symmetric matrix optimization problems regularized by nonsmooth spectral functions. These sufficient conditions are derived via the study of the $\mathcal{C}^2$-cone reducibility of spectral functions and the metric subregularity of their subdifferentials, respectively. As an application, we demonstrate how quadratic growth conditions are used to guarantee the desirable fast convergence rates of the augmented Lagrangian methods (ALM) for s…
For the inclusion problem involving two maximal monotone operators, under the metric subregularity of the composite operator, we derive the linear convergence of the generalized proximal point algorithm and several splitting algorithms, which include the over-relaxed forward-backward splitting algorithm, the generalized Douglas-Rachford splitting algorithm and Davis' three-operator splitting algorithm. To the best of our knowledge, this linear convergence condition is weaker than the existing ones that almost all require the strong monotonicity of the composite operator. Withal, we give some s…
Within convex analysis, a rich theory with various applications has been evolving since the proximal average of convex functions was first introduced over a decade ago. When one considers the subdifferential of the proximal average, a natural averaging operation of the subdifferentials of the averaged functions emerges. In the present paper we extend the reach of this averaging operation to the framework of monotone operator theory in Hilbert spaces, transforming it into the resolvent average. The theory of resolvent averages contains many desirable properties. In particular, we study a detail…
In this paper, we study the D-gap function associated with a nonsmooth and nonmonotone variational inequality problem. We present some exact formulas for the subderivative, the regular subdifferential set, and the limiting subdifferential set of the D-gap function. By virtue of these formulas, we provide some sufficient and necessary conditions for the Kurdyka-Łojasiewicz inequality property and the error bound property for the D-gap functions. As an application of our Kurdyka-Łojasiewicz inequality result and the abstract convergence result in [Attouch, et al., Convergence of descent methods …
A Stochastic Block-coordinate Proximal Newton Method for Nonconvex Composite Minimization
School of Mathematical Sciences, Jiangsu University（江苏大学数学科学学院）；Center of Excellence for Generative AI, King Abdullah University of Science and Technology（阿卜杜拉国王科技大学生成式人工智能卓越中心）
In this paper we investigate the sensitivity analysis of parameterized nonlinear variational inequalities of second kind in a Hilbert space. The challenge of the present work is to take into account a perturbation on all the data of the problem. This requires special adjustments in the definitions of the generalized first- and second-order differentiations of the involved operators and functions. Precisely, we extend the notions, introduced and thoroughly studied by R.T. Rockafellar, of twice epi-differentiability and proto-differentiability to the case of a parameterized lower semi-continuous…
We prove that every function $f:\mathbb{R}^n\to \mathbb{R}$ satisfies that the image of the set of critical points at which the function $f$ has Taylor expansions of order $n-1$ and non-empty subdifferentials of order $n$ is a Lebesgue-null set. As a by-product of our proof, for the proximal subdifferential $\partial_{P}$, we see that for every lower semicontinuous function $f:\mathbb{R}^2\to\mathbb{R}$ the set $f(\{x\in\mathbb{R}^2 : 0\in\partial_{P}f(x)\})$ is $\mathcal{L}^{1}$-null.
We consider a class of monotone operators which are appropriate for symbolic representation and manipulation within a computer algebra system. Various structural properties of the class (e.g., closure under taking inverses, resolvents) are investigated as well as the role played by maximal monotonicity within the class. In particular, we show that there is a natural correspondence between our class of monotone operators and the subdifferentials of convex functions belonging to a class of convex functions deemed suitable for symbolic computation of Fenchel conjugates which were previously studi…
