We study the problem of when the continuous linear image of a fixed closed convex set $X \subset\mathbb{R}^n$ is closed. Specifically, we improve the main results in the papers \cite{Borwein2009, Borwein2010} by showing that for all, except for at most a $σ$-porous set, of the linear mappings $T$ from $\mathbb{R}^n$ into $\mathbb{R}^m,$ not only $T(X)$ is closed, but there is also an open neighborhood of $T$ whose members also preserve the closedness of $X.$
This work presents a collection of useful properties of the Moreau envelope for finite-dimensional, proper, lower semicontinuous, convex functions. In particular, gauge functions and piecewise cubic functions are investigated and their Moreau envelopes categorized. Characterizations of convex Moreau envelopes are established; topics include strict convexity, strong convexity and Lipschitz continuity.
It is well known in convex analysis that proximal mappings on Hilbert spaces are $1$-Lipschitz. In the present paper we show that proximal mappings on uniformly convex Banach spaces are uniformly continuous on bounded sets. Moreover, we introduce a new general proximal mapping whose regularization term is given as a composition of a Young function and the norm, and formulate our results at this level of generality. It is our aim to obtain the corresponding modulus of uniform continuity explicitly in terms of a modulus of uniform convexity of the norm and of moduli witnessing properties of the …
Monotone operators and (firmly) nonexpansive mappings are fundamental objects in modern analysis and computational optimization. Five years ago, it was shown that if finitely many firmly nonexpansive mappings have or "almost have" fixed points, then the same is true for compositions and convex combinations. More recently, sharp information about the minimal displacement vector of compositions and of convex combinations of firmly nonexpansive mappings was obtained in terms of the displacement vectors of the underlying operators. Using a new proof technique based on the Brezis-Haraux theorem and…
Maximally monotone operators and firmly nonexpansive mappings play key roles in modern optimization and nonlinear analysis. Five years ago, it was shown that if finitely many firmly nonexpansive operators are all asymptotically regular (i.e., the have or "almost have" fixed points), then the same is true for compositions and convex combinations. In this paper, we derive bounds on the magnitude of the minimal displacement vectors of compositions and of convex combinations in terms of the displacement vectors of the underlying operators. Our results completely generalize earlier works. Moreover,…
The notion of the angle between two subspaces has a long history, dating back to Friedrichs's work in 1937 and Dixmier's work on the minimal angle in 1949. In 2006, Deutsch and Hundal studied extensions to convex sets in order to analyze convergence rates for the cyclic projections algorithm. In this work, we characterize the positivity of the minimal angle between two convex cones. We show the existence of, and necessary conditions for, optimal solutions of minimal angle problems associated with two convex subsets as well. Moreover, we generalize a result by Deutsch on minimal angles from lin…
We show that in the framework of CAT(0) spaces, any convex combination of two mappings which are firmly nonexpansive -- or which satisfy the more general property $(P_2)$ -- is asymptotically regular, conditional on its fixed point set being nonempty, and, in addition, also $Δ$-convergent to such a fixed point. These results are established by the construction and study of a convex combination metric on the Cartesian square of a CAT(0) space. We also derive a uniform rate of asymptotic regularity in the sense of proof mining. All these results are then interpreted in the special case of the ma…
Monotonicity and convex analysis arise naturally in the framework of multi-marginal optimal transport theory. However, a comprehensive multi-marginal monotonicity and convex analysis theory is still missing. To this end we study extensions of classical monotone operator theory and convex analysis into the multi-marginal setting. We characterize multi-marginal c-monotonicity in terms of classical monotonicity and firmly nonexpansive mappings. We provide Minty type, continuity and conjugacy criteria for multi-marginal maximal monotonicity. We extend the partition of the identity into a sum of fi…
Recently, Simons provided a lemma for a support function of a closed convex set in a general Hilbert space and used it to prove the geometry conjecture on cycles of projections. In this paper, we extend Simons's lemma to closed convex functions, show its connections to Attouch-Thera duality, and use it to characterize (classical and phantom) cycles and gap vectors of proximal mappings.
In this paper, we introduce the concept of nearly convex set-valued mappings and investigate fundamental properties of these mappings. Additionally, we establish a geometric approach for generalized differentiation of nearly convex set-valued mappings and nearly convex functions. Our contributions expand the current knowledge of nearly convex sets and functions, while providing several new results pertaining to nearly convex set-valued mappings.
This paper aims at providing further studies of the notion of quasi-relative interior for convex sets introduced by Borwein and Lewis. We obtain new formulas for representing quasi-relative interiors of convex graphs of set-valued mappings and for convex epigraphs of extended-real-valued functions defined on locally convex topological vector spaces. We also show that the role, which this notion plays in infinite dimensions and the results obtained in this vein, are similar to those involving relative interior in finite-dimensional spaces.
This work concerns the local convergence theory of Newton and quasi-Newton methods for convex-composite optimization: minimize f(x):=h(c(x)), where h is an infinite-valued proper convex function and c is C^2-smooth. We focus on the case where h is infinite-valued piecewise linear-quadratic and convex. Such problems include nonlinear programming, mini-max optimization, estimation of nonlinear dynamics with non-Gaussian noise as well as many modern approaches to large-scale data analysis and machine learning. Our approach embeds the optimality conditions for convex-composite optimization problem…
This paper concerns the robust vector problems \begin{equation*} \mathrm{(RVP)}\ \ {\rm Wmin}\left\{ F(x): x\in C,\; G_u(x)\in -S,\;\forall u\in\mathcal{U}\right\}, \end{equation*} where $X, Y, Z$ are locally convex Hausdorff topological vector spaces, $K$ is a closed and convex cone in $Y$ with nonempty interior, and $S$ is a closed, convex cone in $Z$, $\mathcal{U}$ is an \textit{uncertainty set}, $F\colon X\rightarrow {Y}^\bullet,$ $G_u\colon X\rightarrow Z^\bullet$ are proper mappings for all $ u \in \mathcal{U}$, and $\emptyset \ne C\subset X$. Let $ A:=C\cap \left(\bigcap_{u\in\mathcal{U…
Using techniques of variational analysis, necessary and sufficient subdifferential conditions for Hölder error bounds are investigated and some new estimates for the corresponding modulus are obtained. As an application, we consider the setting of convex semi-infinite optimization and give a characterization of the Hölder calmness of the argmin mapping in terms of the level set mapping (with respect to the objective function) and a special supremum function. We also estimate the Hölder calmness modulus of the argmin mapping in the framework of linear programming.
The restricted strong convexity is an effective tool for deriving globally linear convergence rates of descent methods in convex minimization. Recently, the global error bound and quadratic growth properties appeared as new competitors. In this paper, with the help of Ekeland's variational principle, we show the equivalence between these three notions. To deal with convex minimization over a closed convex set and structured convex optimization, we propose a group of modified versions and a group of extended versions of these three notions by using gradient mapping and proximal gradient mapping…
In this paper, we introduce new properties of the relative interior calculus for nearly convex sets, functions, and set-valued mappings. These properties are important for the development of duality theory in optimization. Then we investigate optimal value functions defined by nearly convex functions and nearly convex set-valued mappings, and derive the near convexity of the optimal value function under a qualification condition. We also develop formulas for subgradients and Fenchel conjugates of this class of functions, and explore their applications to duality theory.
Online Optimization of Difference-of-Convex Compositions with Smooth Mappings
Management Science and Engineering, Stanford University（斯坦福大学管理科学与工程系）；The Daniel J. Epstein Department of Industrial and Systems Engineering, University of Southern California（南加州大学丹尼尔·J·埃普斯坦工业与系统工程系）
There are many important practical optimization problems whose feasible regions are not known to be nonempty or not, and optimizers of the objective function with the least constraint violation prefer to be found. A natural way for dealing with these problems is to extend the nonlinear optimization problem as the one optimizing the objective function over the set of points with the least constraint violation. This leads to the study of the shifted problem. This paper focuses on the constrained convex optimization problem. The sufficient condition for the closedness of the set of feasible shift…
