This paper deals with approximate solutions of a nonsmooth semi-infinite programming with multiple interval-valued objective functions. We first introduce four types of approximate quasi Pareto solutions of the considered problem by considering the lower-upper interval order relation and then apply some advanced tools of variational analysis and generalized differentiation to establish necessary optimality conditions for these approximate solutions. Sufficient conditions for approximate quasi Pareto solutions of such a problem are also provided by means of introducing the concepts of approximate (strictly) pseudo-quasi generalized convex functions defined in terms of the limiting subdifferential of locally Lipschitz functions. Finally, a Mond--Weir type dual model in approximate form is formulated, and weak, strong and converse-like duality relations are proposed.
In this paper, we present some new necessary and sufficient optimality conditions in terms of the Clarke subdifferentials for approximate Pareto solutions of a nonsmooth vector optimization problem which has an infinite number of constraints. As a consequence, we obtain optimality conditions for the particular cases of cone-constrained convex vector optimization problems and semidefinite vector optimization problems. Examples are given to illustrate the obtained results.
In a general Hilbert framework, we consider continuous gradient-like dynamical systems for constrained multiobjective optimization involving non-smooth convex objective functions. Our approach is in the line of a previous work where was considered the case of convex di erentiable objective functions. Based on the Yosida regularization of the subdi erential operators involved in the system, we obtain the existence of strong global trajectories. We prove a descent property for each objective function, and the convergence of trajectories to weak Pareto minima. This approach provides a dynamical e…
This paper deals with Pareto solutions of a nonsmooth fractional interval-valued multiobjective optimization. We first introduce four types of Pareto solutions of the considered problem by considering the lower-upper interval order relation and then apply some advanced tools of variational analysis and generalized differentiation to establish necessary optimality conditions for these solutions. Sufficient conditions for Pareto solutions of such a problem are also provided by means of introducing the concepts of (strictly) generalized convex functions defined in terms of the limiting/Mordukhovi…
In this paper, we revisit the Mordukhovich's subdifferential criterion for Lipschitz continuity of nonsmooth functions and coderivative criterion for the Aubin/Lipschitz-like property of set-valued mappings in finite dimensions. The criteria are useful and beautiful results in modern variational analysis showing the state of the art of the field. As an application, we establish necessary and sufficient conditions for Lipschitz continuity of the minimal time function and the scalarization function, that play an important role in many aspects of nonsmooth analysis and optimization.
In this article, we introduce the idea of $gH$-weak subdifferential for interval-valued functions (IVFs) and show how to calculate $gH$-weak subgradients. It is observed that a nonempty $gH$-weak subdifferential set is closed and convex. In characterizing the class of functions for which the $gH$-weak subdifferential set is nonempty, it is identified that this class is the collection of $gH$-lower Lipschitz IVFs. In checking the validity of sum rule of $gH$-weak subdifferential for a pair of IVFs, a counterexample is obtained, which reflects that the sum rule does not hold. However, under a mi…
In the early 1960's, Moreau and Rockafellar introduced a concept of called \emph{subgradient} for convex functions, initiating the developments of theoretical and applied convex analysis. The needs of going beyond convexity motivated the pioneer works by Clarke considering generalized differentiation theory of Lipschitz continuous functions. Although Clarke generalized differentiation theory is applicable for nonconvex functions, convexity still plays a crucial role in Clarke subdifferential calculus. In the mid 1970's, Mordukhovich developed another generalized differentiation theory for nonc…
The objective of this paper is to provide a convergent numerical approximation of the Pareto optimal set for finite-horizon multiobjective optimal control problems for which the objective space is not necessarily convex. Our approach is based on Viability Theory. We first introduce the set-valued return function V and show that the epigraph of V is equal to the viability kernel of a properly chosen closed set for a properly chosen dynamics. We then introduce an approximate set-valued return function with finite set-values as the solution of a multiobjective dynamic programming equation. The ep…
In this article, we present an efficient descent method for locally Lipschitz continuous multiobjective optimization problems (MOPs). The method is realized by combining a theoretical result regarding the computation of descent directions for nonsmooth MOPs with a practical method to approximate the subdifferentials of the objective functions. We show convergence to points which satisfy a necessary condition for Pareto optimality. Using a set of test problems, we compare our method to the multiobjective proximal bundle method by Mäkelä. The results indicate that our method is competitive while…
For solving constrained multicriteria problems, we introduce the multiobjective barrier method (MBM), which extends the scalar-valued internal penalty method. This multiobjective version of the classical method also requires a penalty barrier for the feasible set and a sequence of nonnegative penalty parameters. Differently from the single-valued procedure, MBM is implemented by means of an auxiliary "monotonic" real-valued mapping, which may be chosen in a quite large set of functions. Here, we consider problems with continuous objective functions, where the feasible sets are defined by finit…
The paper proposes and develops new globally convergent algorithms of the generalized damped Newton type for solving important classes of nonsmooth optimization problems. These algorithms are based on the theory and calculations of second-order subdifferentials of nonsmooth functions with employing the machinery of second-order variational analysis and generalized differentiation. First we develop a globally superlinearly convergent damped Newton-type algorithm for the class of continuously differentiable functions with Lipschitzian gradients, which are nonsmooth of second order. Then we desig…
In this work, we consider multiobjective optimization problems with both bound constraints on the variables and general nonlinear constraints, where objective and constraint function values can only be obtained by querying a black box. Furthermore, we consider the case where a subset of the variables can only take integer values. We propose a new linesearch-based solution method and show that it converges to a set of stationary points for the problem. For what concerns the continuous variables, we employ a strategy for the estimation of the Pareto frontier recently proposed in the literature a…
In this paper we study an optimal control problem with nonsmooth mixed state and control constraints. In most of the existing results, the necessary optimality condition for optimal control problems with mixed state and control constraints are derived under the Mangasarian-Fromovitz condition and under the assumption that the state and control constraint functions are smooth. In this paper we derive necessary optimality conditions for problems with nonsmooth mixed state and control constraints under constraint qualifications based on pseudo-Lipschitz continuity and calmness of certain set-valu…
We generalize a Maximum Principle for optimal control problems involving sweeping systems previously derived in ``Necessary conditions for optimal control problems with sweeping systems and end point constraints'', by de Pinho, Ferreira and Smirnov, Optimization, N. 71, 11, 2022, to cover the case where the moving set may be nonsmooth. Noteworthy, we consider problems with constrained end point. A remarkable feature of our work is that we rely upon an ingenious smooth approximating family of standard differential equations in the vein of that used in ``Optimal Control involving Sweeping Proces…
In this paper, the distributed resource allocation problem on strongly connected and weight-balanced digraphs is investigated, where the decisions of each agent are restricted to satisfy the coupled network resource constraints and heterogeneous general convex sets. Moreover, the local cost function can be non-smooth. In order to achieve the exact optimum of the nonsmooth resource allocation problem, a novel continuous-time distributed algorithm based on the gradient descent scheme and differentiated projection operators is proposed. With the help of the set-valued LaSalle invariance principle…
This paper aims at developing two versions of the generalized Newton method to compute not merely arbitrary local minimizers of nonsmooth optimization problems but just those, which possess an important stability property known as tilt stability. We start with unconstrained minimization of continuously differentiable cost functions having Lipschitzian gradients and suggest two second-order algorithms of the Newton type: one involving coderivatives of Lipschitzian gradient mappings, and the other based on graphical derivatives of the latter. Then we proceed with the propagation of these algorit…
In this study, a \emph{$gH$-subgradient technique} is developed to obtain efficient solutions to the optimization problems with nonsmooth nonlinear convex interval-valued functions. The algorithmic implementation of the developed $gH$-subgradient technique is illustrated. As an application of the proposed \emph{$gH$-subgradient technique}, an $\ell_1$ penalized linear regression problem, known as a \emph{lasso problem}, with interval-valued features is solved.
Toulouse School of Economics（图卢兹经济学院）；Université Toulouse 1 Capitole（图卢兹第一大学）；IRIT（图卢兹计算机研究所）；Université de Toulouse（图卢兹大学）；IRT Saint Exupery（圣埃克苏佩里技术研究院）
Modern problems in AI or in numerical analysis require nonsmooth approaches with a flexible calculus. We introduce generalized derivatives called conservative fields for which we develop a calculus and provide representation formulas. Functions having a conservative field are called path differentiable: convex, concave, Clarke regular and any semialgebraic Lipschitz continuous functions are path differentiable. Using Whitney stratification techniques for semialgebraic and definable sets, our model provides variational formulas for nonsmooth automatic differentiation oracles, as for instance th…
During the last years, asymptotic (or sequential) constraint qualifications, which postulate upper semicontinuity of certain set-valued mappings and provide a natural companion of asymptotic stationarity conditions, have been shown to be comparatively mild, on the one hand, while possessing inherent practical relevance from the viewpoint of numerical solution methods, on the other one. Based on recent developments, the theory in this paper enriches asymptotic constraint qualifications for very general nonsmooth optimization problems over inverse images of set-valued mappings by incorporating d…
We establish the following result: if the graph of a (nonsmooth) real-extended-valued function $f:\mathbb{R}^{n}\to \mathbb{R}\cup\{+\infty\}$ is closed and admits a Whitney stratification, then the norm of the gradient of $f$ at $x\in{dom}f$ relative to the stratum containing $x$ bounds from below all norms of Clarke subgradients of $f$ at $x$. As a consequence, we obtain some Morse-Sard type theorems as well as a nonsmooth Kurdyka-Łojasiewicz inequality for functions definable in an arbitrary o-minimal structure.
In this paper, we consider a multiobjective optimal control problem where the preference relation in the objective space is defined in terms of a pointed convex cone containing the origin, which defines generalized Pareto optimality. For this problem, we introduce the set-valued return function V and provide a unique characterization for V in terms of contingent derivative and coderivative for set-valued maps, which extends two previously introduced notions of generalized solution to the Hamilton-Jacobi equation for single objective optimal control problems.
For a broad class of nonlinear systems, we formulate the problem of guaranteeing safety with optimality under constraints. Specifically, we define controlled safety for differential inclusions with constraints on the states and the inputs. Through the use of nonsmooth analysis tools, we show that a continuous optimal control law can be selected from a set-valued constraint capturing the system constraints and conditions guaranteeing safety using control barrier functions. Our results guarantee optimality and safety via a continuous state-feedback law designed using nonsmooth control barrier fu…
The paper is devoted to the existence of global optimal solutions for a general class of nonsmooth problems of constrained vector optimization without boundedness assumptions on constraint sets. The main attention is paid to the two major notions of optimality in vector problems: Pareto efficiency and proper efficiency in the sense of Geoffrion. Employing adequate tools of variational analysis and generalized differentiation, we first establish relationships between the notions of properness, $M$-tameness, and the Palais--Smale conditions formulated for the restriction of the vector cost mappi…
Toulouse School of Economics, University of Toulouse Capitole（图卢兹经济学院，图卢兹第一大学）；IRIT, CNRS, Université de Toulouse, ANITI（图卢兹信息学研究所，法国国家科学研究中心，图卢兹大学，图卢兹人工智能与自然智能研究所）
Differentiation along algorithms, i.e., piggyback propagation of derivatives, is now routinely used to differentiate iterative solvers in differentiable programming. Asymptotics is well understood for many smooth problems but the nondifferentiable case is hardly considered. Is there a limiting object for nonsmooth piggyback automatic differentiation (AD)? Does it have any variational meaning and can it be used effectively in machine learning? Is there a connection with classical derivative? All these questions are addressed under appropriate nonexpansivity conditions in the framework of conser…
Higher order necessary conditions for a minimizer of an optimal control problem are generally obtained for systems whose dynamics is continuously differentiable in the state variable. Here, by making use of the notion of set-valued Lie bracket we obtain a Goh-type condition for a control affine system with Lipschitz continuous dynamics and unbounded controls. In order to manage the simultaneous lack of smoothness of the adjoint equation and of the Lie bracket-like variations we make use of the notion of Quasi Differential Quotient. We conclude the paper with a worked out example where the esta…
Randomized Coordinate Subgradient Method for Nonsmooth Composite Optimization
Institute of Translational Medicine（转化医学研究院）；National Center for Translational Medicine（国家转化医学中心）；Shanghai Jiao Tong University（上海交通大学）；Alibaba Group（阿里巴巴集团）；Antai College of Economics and Management（安泰经济与管理学院）；The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；School of Data Science（数据科学学院）；Xiangfu Laboratory（祥符实验室）
We consider descent methods for solving non-finite valued nonsmooth convex-composite optimization problems that employ Gauss-Newton subproblems to determine the iteration update. Specifically, we establish the global convergence properties for descent methods that use a backtracking line search, a weak Wolfe line search, or a trust-region update. All of these approaches are designed to exploit the structure associated with convex-composite problems.
