In this paper, we develop an interior-point method for solving a class of convex optimization problems with time-varying objective and constraint functions. Using log-barrier penalty functions, we propose a continuous-time dynamical system for tracking the (time-varying) optimal solution with an asymptotically vanishing error. This dynamical system is composed of two terms: (i) a correction term consisting of a continuous-time version of Newton's method, and (ii) a prediction term able to track the drift of the optimal solution by taking into account the time-varying nature of the objective and constraint functions. Using appropriately chosen time-varying slack and barrier parameters, we ensure that the solution to this dynamical system globally asymptotically converges to the optimal solution at an exponential rate. We illustrate the applicability of the proposed method in two practical applications: a sparsity promoting least squares problem and a collision-free robot navigation problem.
This paper aims at providing further studies of the notion of quasi-relative interior for convex sets introduced by Borwein and Lewis. We obtain new formulas for representing quasi-relative interiors of convex graphs of set-valued mappings and for convex epigraphs of extended-real-valued functions defined on locally convex topological vector spaces. We also show that the role, which this notion plays in infinite dimensions and the results obtained in this vein, are similar to those involving relative interior in finite-dimensional spaces.
This paper consists of four general parts: convex sets; convex functions; convex optimization; and the interior-point algorithm. I will start by introducing the definition of convex sets and give three common convex set examples which will be used later in this paper, then prove the significant separating and supporting hyperplane theorems. Stepping into convex functions, in addition to offering definitions, I will also prove the first order and second-order conditions for convexity of a function, and then introduce a couple of examples that will be used in a convex optimization problem later.…
Applying an interior-point method to the central-path conditions is a widely used approach for solving quadratic programs. Reformulating these conditions in the log-domain is a natural variation on this approach that to our knowledge is previously unstudied. In this paper, we analyze log-domain interior-point methods and prove their polynomial-time convergence. We also prove that they are approximated by classical barrier methods in a precise sense and provide simple computational experiments illustrating their superior performance.
In recent years, by using Bregman distance, the Lipschitz gradient continuity and strong convexity were lifted and replaced by relative smoothness and relative strong convexity. Under the mild assumptions, it was proved that gradient methods with Bregman regularity converge linearly for single-objective optimization problems (SOPs). In this paper, we extend the relative smoothness and relative strong convexity to vector-valued functions and analyze the convergence of an interior Bregman gradient method for vector optimization problems (VOPs). Specifically, the global convergence rates are $\ma…
Auxiliary variables are often used to model a convex piecewise linear function in the framework of linear optimization. This work shows that such variables yield a block diagonal plus low rank structure in the reduced KKT system of the dual problem. We show how the structure can be detected efficiently, and derive the linear algebra formulas for an interior point method which exploit such structure. The structure is detected in 36% of the cases in Netlib. Numerical results on the inverse planning problem in radiation therapy show an order of magnitude speed-up compared to the state-of-the-art …
This paper addresses the study and applications of polyhedral duality of locally convex topological vector (LCTV) spaces. We first revisit the classical Rockafellar's proper separation theorem for two convex sets one which is polyhedral and then present its LCTV extension with replacing the relative interior by its quasi-relative interior counterpart. Then we apply this result to derive enhanced calculus rules for normals to convex sets, coderivatives of convex set-valued mappings, and subgradients of extended-real-valued functions under certain polyhedrality requirements in LCTV spaces by dev…
A global linear and local superlinear/quadratic inexact non-interior continuation method for variational inequalities
我们使用的概念，障碍为基础的平滑近似介绍[ C。B. Chua和Z. Li，A barrier-based smoothing邻近点法for NCP over closed凸锥，SIOPT 23（2），2010]，以扩展[B. Chen和N. Xiu，A global linear and local quadratic non-interior continuation method for nonlinear互补性问题based on Chen-Mangasarian smoothing functions，SIOPT 9（3），1999]到一般闭凸集上变分不等式的不精确非内部连续方法.为了处理高维问题，该方法中涉及的牛顿方程是不精确求解的。在适当的假设下，证明了该方法具有全局线性收敛性和局部超线性/平方收敛性.我们将此方法应用于非负正交图、半正定锥、多面体集、矩阵算子范数锥的上图和矩阵核范数锥的上图。
This note studies the distributed non-convex optimization problem with non-smooth regularization, which has wide applications in decentralized learning, estimation and control. The objective function is the sum of different local objective functions, which consist of differentiable (possibly non-convex) cost functions and non-smooth convex functions. This paper presents a distributed proximal gradient algorithm for the non-smooth non-convex optimization problem over time-varying multi-agent networks. Each agent updates local variable estimate by the multi-step consensus operator and the proxim…
In this paper, a time-varying distributed convex optimization problem is studied for continuous-time multi-agent systems. Control algorithms are designed for the cases of single-integrator and double-integrator dynamics. Two discontinuous algorithms based on the signum function are proposed to solve the problem in each case. Then in the case of double-integrator dynamics, two continuous algorithms based on, respectively, a time-varying and a fixed boundary layer are proposed as continuous approximations of the signum function. Also, to account for inter-agent collision for physical agents, a d…
Dalian University of Technology（大连理工大学）；Pazhou Lab（琶洲实验室）；The University of Hong Kong（香港大学）；Southern University of Science and Technology（南方科技大学）；National Center for Applied Mathematics Shenzhen（深圳国家应用数学中心）
Bi-level optimization model is able to capture a wide range of complex learning tasks with practical interest. Due to the witnessed efficiency in solving bi-level programs, gradient-based methods have gained popularity in the machine learning community. In this work, we propose a new gradient-based solution scheme, namely, the Bi-level Value-Function-based Interior-point Method (BVFIM). Following the main idea of the log-barrier interior-point scheme, we penalize the regularized value function of the lower level problem into the upper level objective. By further solving a sequence of different…
In this paper, we address the efficient numerical solution of linear and quadratic programming problems, often of large scale. With this aim, we devise an infeasible interior point method, blended with the proximal method of multipliers, which in turn results in a primal-dual regularized interior point method. Application of this method gives rise to a sequence of increasingly ill-conditioned linear systems which cannot always be solved by factorization methods, due to memory and CPU time restrictions. We propose a novel preconditioning strategy which is based on a suitable sparsification of t…
