When the objective function is not locally Lipschitz, constraint qualifications are no longer sufficient for Karush-Kuhn-Tucker (KKT) conditions to hold at a local minimizer, let alone ensuring an exact penalization. In this paper, we extend quasi-normality and relaxed constant positive linear dependence (RCPLD) condition to allow the non-Lipschitzness of the objective function and show that they are sufficient for KKT conditions to be necessary for optimality. Moreover, we derive exact penalization results for the following two special cases. When the non-Lipschitz term in the objective function is the sum of a composite function of a separable lower semi-continuous function with a continuous function and an indicator function of a closed subset, we show that a local minimizer of our problem is also a local minimizer of an exact penalization problem under a local error bound condition for a restricted constraint region and a suitable assumption on the outer separable function. When the non-Lipschitz term is the sum of a continuous function and an indicator function of a closed subset, we also show that our problem admits an exact penalization under an extended quasi-normality involving the coderivative of the continuous function.
We present a method to solve a special class of parameter identification problems for an elliptic optimal control problem to global optimality. The bilevel problem is reformulated via the optimal-value function of the lower-level problem. The reformulated problem is nonconvex and standard regularity conditions like Robinson's CQ are violated. Via a relaxation of the constraints, the problem can be decomposed into a family of convex problems and this is the basis for a solution algorithm. The convergence properties are analyzed. It is shown that a penalty method can be employed to solve this fa…
Approximate necessary optimality conditions in terms of Fréchet subgradients and normals for a rather general optimization problem with a potentially non-Lipschitzian objective function are established with the aid of Ekeland's variational principle, the fuzzy Fréchet subdifferential sum rule, and a novel notion of lower semicontinuity relative to a set-valued mapping or set. Feasible points satisfying these optimality conditions are referred to as approximately stationary. As applications, we derive a new general version of the extremal principle. Furthermore, we study approximate stationarit…
In the present paper, we are concerned with a class of constrained vector optimization problems, where the objective functions and active constraint functions are locally Lipschitz at the referee point. Some second-order constraint qualifications of Zangwill type, Abadie type and Mangasarian~--~Fromovitz type as well as a regularity condition of Abadie type are proposed in a nonsmooth setting. The connections between these proposed conditions are established. They are applied to develop second-order Karush--Kuhn--Tucker necessary optimality conditions for local (weak, Geoffrion properly) effic…
This work is concerned with a class of optimal control problems governed by a partial differential equation that are motivated by an application in radiotherapy treatment planning, where the primary design objective is to minimize the volume where a functional of the state violates a prescribed level, but prescribing these levels in the form of pointwise state constraints can lead to infeasible problems. We therefore propose an alternative approach based on $L^1$ penalization of the violation. We establish well-posedness of the corresponding optimal control problem, derive first-order optimali…
Fixed point algorithms play an important role to compute feasible solutions to the radio power control problems in wireless networks. Although these algorithms are shown to converge to the fixed points that give feasible problem solutions, the solutions often lack notion of problem optimality. This paper reconsiders well known fixed point algorithms such as those with standard and type-II standard interference functions, and investigates the conditions under which they give optimal power control solutions by the recently proposed Fast-Lipschitz optimization framework. When the qualifying condi…
We investigate conditions of optimality for an infinite horizon control problem and consider their correspondence with the value function. Assuming Lipschitz continuity of the value function, we prove that sensitivity relations plus the normal form version of the Pontryagin Maximum Principle is a necessary and sufficient condition for the optimality criteria that correspond to this value function. Different criteria of optimality under different asymptotic constraints may be used, including almost strong and classical optimality proposed by D.Bogusz. Special attention is devoted to weakly agre…
A phase field approach for structural topology optimization with application to additive manufacturing is analyzed. The main novelty is the penalization of overhangs (regions of the design that require underlying support structures during construction) with anisotropic energy functionals. Convex and non-convex examples are provided, with the latter showcasing oscillatory behavior along the object boundary termed the dripping effect in the literature. We provide a rigorous mathematical analysis for the structural topology optimization problem with convex and non-continuously-differentiable anis…
In the recent paper of Giorgi, Jiménez and Novo (J Optim Theory Appl 171:70--89, 2016), the authors introduced the so-called approximate Karush-Kuhn-Tucker (AKKT) condition for smooth multiobjective optimization problems and obtained some AKKT-type necessary optimality conditions and sufficient optimality conditions for weak efficient solutions of such a problem. In this note, we extend these optimality conditions to locally Lipschitz multiobjective optimization problems using Mordukhovich subdifferentials. Furthermore, we prove that, under some suitable additional conditions, an AKKT conditio…
In this paper, an optimal control problem governed by a class of p-Laplacian elliptic equations is studied. In particular, as no monotonicity assumption is assumed on the nonlinear term, the state equation may admit several solutions for one control. To obtain optimality conditions for an optimal pair, the multiplicity and singularity/degeneracy of the state equation need to be handled respectively. For this reason, penalization problems and approximation problems are introduced. Finally the main result is proved by a series of process of taking to the limits.
This paper considers mathematical programs, whose constraints are expressed by a parameterized vector equilibrium problem. The latter is a well recognized framework, which is able to cover multicriteria optimization, vector variational inequalities and complementarity problems. As the solutions to vector equilibrium problems are here intended in a strong sense, the consequent MPEC problems result in a class still little explored by the existing literature. Some necessary optimality conditions for such programs are established following a penalization approach. To derive and express these condi…
In this paper, we give an overview on optimality conditions and exact penalization for the mathematical program with switching constraints (MPSC). MPSC is a new class of optimization problems which has some important applications. It is well-known that if MPSC is treated as a standard nonlinear program, some of the usual constraint qualifications may fail and to deal with this issue one could reformulate it as a mathematical program with disjunctive constraints (MPDC). In this paper we first survey recent results on constraint qualifications and optimality conditions for MPDC and then apply th…
We consider non-autonomous calculus of variations problems with a state constraint represented by a given closed set. We prove that if the interior of the Clarke tangent cone of the state constraint set is non-empty (this is the constraint qualification that we suggest here), then the necessary optimality conditions apply in the normal form. We establish normality results for (weak) local minimizers and global minimizers, employing two different approaches and invoking slightly diverse assumptions. More precisely, for the local minimizers result, the Lagrangian is supposed to be Lipschitz with…
We consider the Lagrange problem of optimal control with unrestricted controls and address the question: under what conditions we can assure optimal controls are bounded? This question is related to the one of Lipschitzian regularity of optimal trajectories, and the answer to it is crucial for closing the gap between the conditions arising in the existence theory and necessary optimality conditions. Rewriting the Lagrange problem in a parametric form, we obtain a relation between the applicability conditions of the Pontryagin maximum principle to the later problem and the Lipschitzian regulari…
In this paper, we introduce the second-order subdifferentials for functions which are Gâteaux differentiable on an open set and whose Gâteaux derivative mapping is locally Lipschitz. Based on properties of this kind of second-order subdifferentials and techniques of variational analysis, we derive second-order necessary conditions for weak Pareto efficient solutions of multiobjective programming problems with constraints.
The cardinality constrained optimization problem (CCOP) is an optimization problem where the maximum number of nonzero components of any feasible point is bounded. In this paper, we consider CCOP as a mathematical program with disjunctive subspaces constraints (MPDSC). Since a subspace is a special case of a convex polyhedral set, MPDSC is a special case of the mathematical program with disjunctive constraints (MPDC). Using the special structure of subspaces, we are able to obtain more precise formulas for the tangent and (directional) normal cones for the disjunctive set of subspaces. We then…
We investigate non-convex optimization problems in $BV(Ω)$ with two-sided pointwise inequality constraints. We propose a regularization and penalization method to numerically solve the problem. Under certain conditions, weak limit points of iterates are stationary for the original problem. In addition, we prove optimality conditions for the original problem that contain Lagrange multipliers to the inequality constraints. Numerical experiments confirm the theoretical findings.
In this paper we investigate necessary conditions of optimality for infinite-horizon optimal control problems with overtaking optimality as an optimality criterion. For the case of local Lipschitz continuity of the payoff function, we construct a boundary condition on the co-state arc that is necessary for the optimality. We also show that, under additional assumptions on the payoff function's asymptotic behavior, the Pontryagin Maximum Principle with this condition becomes a complete system of relations, and this boundary condition points out the unique co-state arc through a Cauchy-type form…
In the present paper, we focus on the vector optimization problems with inequality constraints, where objective functions and constrained functions are Fréchet differentiable, and whose gradient mapping is locally Lipschitz on an open set. By using the second-order symmetric subdifferential and the second-order tangent set, we propose two types of second-order regularity conditions in the sense of Abadie. Then we establish some strong second-order Karush--Kuhn--Tucker necessary optimality conditions for Geoffrion properly efficient solutions of the considered problem. Examples are given to ill…
In this paper we study an optimal control problem with nonsmooth mixed state and control constraints. In most of the existing results, the necessary optimality condition for optimal control problems with mixed state and control constraints are derived under the Mangasarian-Fromovitz condition and under the assumption that the state and control constraint functions are smooth. In this paper we derive necessary optimality conditions for problems with nonsmooth mixed state and control constraints under constraint qualifications based on pseudo-Lipschitz continuity and calmness of certain set-valu…
We consider a class of constrained optimization problems with a possibly nonconvex non-Lipschitz objective and a convex feasible set being the intersection of a polyhedron and a possibly degenerate ellipsoid. Such problems have a wide range of applications in data science, where the objective is used for inducing sparsity in the solutions while the constraint set models the noise tolerance and incorporates other prior information for data fitting. To solve this class of constrained optimization problems, a common approach is the penalty method. However, there is little theory on exact penaliza…
In this article, we present an efficient descent method for locally Lipschitz continuous multiobjective optimization problems (MOPs). The method is realized by combining a theoretical result regarding the computation of descent directions for nonsmooth MOPs with a practical method to approximate the subdifferentials of the objective functions. We show convergence to points which satisfy a necessary condition for Pareto optimality. Using a set of test problems, we compare our method to the multiobjective proximal bundle method by Mäkelä. The results indicate that our method is competitive while…
This paper deals with Pareto solutions of a nonsmooth fractional interval-valued multiobjective optimization. We first introduce four types of Pareto solutions of the considered problem by considering the lower-upper interval order relation and then apply some advanced tools of variational analysis and generalized differentiation to establish necessary optimality conditions for these solutions. Sufficient conditions for Pareto solutions of such a problem are also provided by means of introducing the concepts of (strictly) generalized convex functions defined in terms of the limiting/Mordukhovi…
We investigate the numerical approximation of an elliptic optimal control problem which involves a nonconvex local regularization of the $L^q$-quasinorm penalization (with $q\in(0,1)$) in the cost function. Our approach is based on the \emph{difference-of-convex} function formulation, which leads to first-order necessary optimality conditions, which can be regarded as the optimality system of an auxiliar convex $L^1$-penalized optimal control problem. We consider piecewise-constant finite element approximation for the controls, whereas the state equation is approximated using piecewise-linear …
In this article we consider a convex feasible set described by inequality constraints that are continuous and not necessarily Lipschitz or convex. We show that if the Slater constraint qualification and a non-degeneracy condition are satisfied, then the Karush-Kuhn-Tucker type optimality condition is both necessary and sufficient. In this way we extend previous results which are proved for Lipschitz and differentiable inequalities.
We study the time optimal control problem with a general target $\mathcal S$ for a class of differential inclusions that satisfy mild smoothness and controllability assumptions. In particular, we do not require Petrov's condition at the boundary of $\mathcal S$. Consequently, the minimum time function $T(\cdot)$ fails to be locally Lipschitz---never mind semiconcave---near $\mathcal S$. Instead of such a regularity, we use an exterior sphere condition for the hypograph of $T(\cdot)$ to develop the analysis. In this way, we obtain dual arc inclusions which we apply to show the constancy of the …
We investigate the value function of an infinite horizon variational problem in the infinite-dimensional setting. Firstly, we provide an upper estimate of its Dini--Hadamard subdifferential in terms of the Clarke subdifferential of the Lipschitz continuous integrand and the Clarke normal cone to the graph of the set-valued mapping describing dynamics. Secondly, we derive a necessary condition for optimality in the form of an adjoint inclusion that grasps a connection between the Euler--Lagrange condition and the maximum principle.
We present two first-order, sequential optimization algorithms to solve constrained optimization problems. We consider a black-box setting with a priori unknown, non-convex objective and constraint functions that have Lipschitz continuous gradients. The proposed algorithms balance the exploration of the a priori unknown feasible space with the pursuit of global optimality within in a pre-specified finite number of first-order oracle calls. The first algorithm accommodates an infeasible start, and provides either a near-optimal global solution or establishes infeasibility. However, the algorith…
We address the problem of optimal scale-dependent parameter learning in total variation image denoising. Such problems are formulated as bilevel optimization instances with total variation denoising problems as lower-level constraints. For the bilevel problem, we are able to derive M-stationarity conditions, after characterizing the corresponding Mordukhovich generalized normal cone and verifying suitable constraint qualification conditions. We also derive B-stationarity conditions, after investigating the Lipschitz continuity and directional differentiability of the lower-level solution opera…
In this article, we introduce the idea of $gH$-weak subdifferential for interval-valued functions (IVFs) and show how to calculate $gH$-weak subgradients. It is observed that a nonempty $gH$-weak subdifferential set is closed and convex. In characterizing the class of functions for which the $gH$-weak subdifferential set is nonempty, it is identified that this class is the collection of $gH$-lower Lipschitz IVFs. In checking the validity of sum rule of $gH$-weak subdifferential for a pair of IVFs, a counterexample is obtained, which reflects that the sum rule does not hold. However, under a mi…
We propose a local regularization of elliptic optimal control problems which involves the nonconvex $L^q$ fractional penalizations in the cost function. The proposed \emph{Huber type} regularization allows us to formulate the PDE constrained optimization formulation as a DC programming problem (difference of convex functions) that is useful to obtain necessary optimality conditions and tackle its numerical solution by applying the well known DC algorithm used in nonconvex optimization problems. By this procedure we approximate the original problem in terms of a consistent family of parameteriz…
We propose a single time-scale stochastic subgradient method for constrained optimization of a composition of several nonsmooth and nonconvex functions. The functions are assumed to be locally Lipschitz and differentiable in a generalized sense. Only stochastic estimates of the values and generalized derivatives of the functions are used. The method is parameter-free. We prove convergence with probability one of the method, by associating with it a system of differential inclusions and devising a nondifferentiable Lyapunov function for this system. For problems with functions having Lipschitz …
Construction of an united theory of the subdifferentials of the first and second orders is interesting for many specialists in optimization \cite{morduchrockafel}. In the paper the rules for construction of the subdifferentials of the first and second orders are introduced. The constructions are done with the help of the Steklov integral of a Lipschitz function $f(\cdot)$ over the images of a set-valued mapping $D(\cdot)$. It is proved that the subdifferential of the first order consisting of the average integral limit values of the gradients $\nabla f(r(\cdot))$, calculated along the curves $…
We derive necessary optimality conditions for minimizers of regular functionals in the calculus of variations under smooth state constraints. In the literature, this classical problem is widely investigated. The novelty of our result lies in the fact that the presence of state constraints enters the Euler-Lagrange equations as a local feedback, which allows to derive the $C^{1,1}$-smoothness of solutions. As an application, we discuss a constrained Mean Field Games problem, for which our optimality conditions allow to construct Lipschitz relaxed solutions, thus improving the existence result i…
Beijing Jiaotong University（北京交通大学）；The Hong Kong Polytechnic University（香港理工大学）；University of California, Davis（加利福尼亚大学戴维斯分校）
In this paper, we propose a Riemannian smoothing steepest descent method to minimize a nonconvex and non-Lipschitz function on submanifolds. The generalized subdifferentials on Riemannian manifold and the Riemannian gradient sub-consistency are defined and discussed. We prove that any accumulation point of the sequence generated by the Riemannian smoothing steepest descent method is a stationary point associated with the smoothing function employed in the method, which is necessary for the local optimality of the original non-Lipschitz problem. Under the Riemannian gradient sub-consistency con…
The paper addresses a new class of optimal control problems governed by the dissipative and discontinuous differential inclusion of the sweeping/Moreau process while using controls to determine the best shape of moving convex polyhedra in order to optimize the given Bolza-type functional, which depends on control and state variables as well as their velocities. Besides the highly non-Lipschitzian nature of the unbounded differential inclusion of the controlled sweeping process, the optimal control problems under consideration contain intrinsic state constraints of the inequality and equality t…
We present a new proof of the turnpike property for nonlinear optimal control problems, when the running target is a steady control-state pair of the underlying system. Our strategy combines the construction of quasi-turnpike controls via controllability, and a bootstrap argument, and does not rely on analyzing the optimality system or linearization techniques. This in turn allows us to address several optimal control problems for finite-dimensional, control-affine systems with globally Lipschitz (possibly nonsmooth) nonlinearities, without any smallness conditions on the initial data or the r…
