In this paper, we propose an improved method for computing the $\mathcal{H}_\infty$ norm of linear dynamical systems that results in a code that is often several times faster than existing methods. By using standard optimization tools to rebalance the work load of the standard algorithm due to Boyd, Balakrishnan, Bruinsma, and Steinbuch, we aim to minimize the number of expensive eigenvalue computations that must be performed. Unlike the standard algorithm, our modified approach can also calculate the $\mathcal{H}_\infty$ norm to full precision with little extra work, and also offers more opportunity to further accelerate its performance via parallelization. Finally, we demonstrate that the local optimization we have employed to speed up the standard globally-convergent algorithm can also be an effective strategy on its own for approximating the $\mathcal{H}_\infty$ norm of large-scale systems.
In this paper, we study the $H_\infty$-norm of linear systems over graphs, which is used to model distribution networks. In particular, we aim to minimize the $H_\infty$-norm subject to allocation of the weights on the edges. The optimization problem is formulated with LMI (Linear-Matrix-Inequality) constraints. For distribution networks with one port, i.e., SISO systems, we show that the $H_\infty$-norm coincides with the effective resistance between the nodes in the port. Moreover, we derive an upper bound of the $H_\infty$-norm, which is in terms of the algebraic connectivity of the graph o…
Mixed norms that promote structured sparsity have numerous applications in signal processing and machine learning problems. In this work, we present a new algorithm, based on a Newton root search technique, for computing the projection onto the $\ell_{\infty,1}$ ball, which has found application in cognitive neuroscience and classification tasks. Numerical simulations show that our proposed method is between 8 and 10 times faster on average, and up to 20 times faster for very sparse solutions, than the previous state of the art. Tests on real functional magnetic resonance image data show that,…
We provide faster algorithms for approximately solving $\ell_{\infty}$ regression, a fundamental problem prevalent in both combinatorial and continuous optimization. In particular, we provide accelerated coordinate descent methods capable of provably exploiting dynamic measures of coordinate smoothness, and apply them to $\ell_\infty$ regression over a box to give algorithms which converge in $k$ iterations at a $O(1/k)$ rate. Our algorithms can be viewed as an alternative approach to the recent breakthrough result of Sherman [She17] which achieves a similar runtime improvement over classic al…
We study a graph-theoretic approach to the $\mathcal{H}_{\infty}$ performance of leader following consensus dynamics on directed and undirected graphs. We first provide graph-theoretic bounds on the system $\mathcal{H}_{\infty}$ norm of the leader following dynamics and show the tightness of the proposed bounds. Then, we discuss the relation between the system $\mathcal{H}_{\infty}$ norm for directed and undirected networks for specific classes of graphs, i.e., balanced digraphs and directed trees. Moreover, we investigate the effects of adding directed edges to a directed tree on the resultin…
The problem of estimating the $\mathcal{H}_\infty$-norm of an LTI system from noisy input/output measurements has attracted recent attention as an alternative to parameter identification for bounding unmodeled dynamics in robust control. In this paper, we study lower bounds for $\mathcal{H}_\infty$-norm estimation under a query model where at each iteration the algorithm chooses a bounded input signal and receives the response of the chosen signal corrupted by white noise. We prove that when the underlying system is an FIR filter, $\mathcal{H}_\infty$-norm estimation is no more efficient than …
We consider stabilization and performance optimization of non-linear controlled systems, where the non-linearity satisfies a sector constraint asymptotically. This leads to optimization of the closed loop peak-to-peak system norm subject to $H_\infty$-performance constraints. Non-linear controlled systems tuned successfully by this novel approach are locally exponentially stable and globally BIBO-stable.
This paper examines the $\mathcal{H}_\infty$ performance problem of the edge agreement protocol for networks of agents operating on independent time scales, connected by weighted edges, and corrupted by exogenous disturbances. $\mathcal{H}_\infty$-norm expressions and bounds are computed that are then used to derive new insights on network performance in terms of the effect of time scales and edge weights on disturbance rejection. We use our bounds to formulate a convex optimization problem for time scale and edge weight selection. Numerical examples are given to illustrate the applicability o…
The differential $\mathcal{L}_{2,p}$ gain of a linear, time-invariant, $p$-dominant system is shown to coincide with the $\mathcal{H}_{\infty,p}$ norm of its transfer function $G$, defined as the essential supremum of the absolute value of $G$ over a vertical strip in the complex plane such that $p$ poles of $G$ lie to right of the strip. The close analogy between the $\mathcal{H}_{\infty,p}$ norm and the classical $\mathcal{H}_{\infty}$ norm suggests that robust dominance of linear systems can be studied along the same lines as robust stability. This property can be exploited in the analysis …
The paper presents two variants of a Krylov-Simplex iterative method that combines Krylov and simplex iterations to minimize the residual $r = b-Ax$. The first method minimizes $\|r\|_\infty$, i.e. maximum of the absolute residuals. The second minimizes $\|r\|_1$, and finds the solution with the least absolute residuals. Both methods search for an optimal solution $x_k$ in a Krylov subspace which results in a small linear programming problem. A specialized simplex algorithm solves this projected problem and finds the optimal linear combination of Krylov basis vectors to approximate the solutio…
In minimum-cost inverse optimization problems, we are given a feasible solution to an underlying optimization problem together with a linear cost function, and the goal is to modify the costs by a small deviation vector so that the input solution becomes optimal. The difference between the new and the original cost functions can be measured in several ways. In this paper, we focus on two objectives: the weighted bottleneck Hamming distance and the weighted $\ell_\infty$-norm. We consider a general model in which the coordinates of the deviation vector are required to fall within given lower an…
We present faster high-accuracy algorithms for computing $\ell_p$-norm minimizing flows. On a graph with $m$ edges, our algorithm can compute a $(1+1/\text{poly}(m))$-approximate unweighted $\ell_p$-norm minimizing flow with $pm^{1+\frac{1}{p-1}+o(1)}$ operations, for any $p \ge 2,$ giving the best bound for all $p\gtrsim 5.24.$ Combined with the algorithm from the work of Adil et al. (SODA '19), we can now compute such flows for any $2\le p\le m^{o(1)}$ in time at most $O(m^{1.24}).$ In comparison, the previous best running time was $Ω(m^{1.33})$ for large constant $p.$ For $p\simδ^{-1}\log m…
The Johns Hopkins University（约翰斯·霍普金斯大学）；University of Illinois at Urbana Champaign（伊利诺伊大学厄巴纳-香槟分校）
Proximal operators are of particular interest in optimization problems dealing with non-smooth objectives because in many practical cases they lead to optimization algorithms whose updates can be computed in closed form or very efficiently. A well-known example is the proximal operator of the vector $\ell_1$ norm, which is given by the soft-thresholding operator. In this paper we study the proximal operator of the mixed $\ell_{1,\infty}$ matrix norm and show that it can be computed in closed form by applying the well-known soft-thresholding operator to each column of the matrix. However, unlik…
