Model order reduction is a technique that is used to construct low-order approximations of large-scale dynamical systems. In this paper, we investigate a balancing based model order reduction method for dynamical systems with a linear dynamical equation and a quadratic output function. To this aim, we propose a new algebraic observability Gramian for the system based on Hilbert space adjoint theory. We then show the proposed Gramians satisfy a particular type of generalized Lyapunov equations and we investigate their connections to energy functionals, namely, the controllability and observability. This allows us to find the states that are hard to control and hard to observe via an appropriate balancing transformation. Truncation of such states yields reduced-order systems. Finally, based on $\mathcal H_2$ energy considerations, we, furthermore, derive error bounds, depending on the neglected singular values. The efficiency of the proposed method is demonstrated by means of two semi-discretized partial differential equations and is compared with the existing model reduction techniques in the literature.
Novel constructions of empirical controllability and observability gramians for nonlinear systems for subsequent use in a balanced truncation style of model reduction are proposed. The new gramians are based on a generalisation of the fundamental solution for a Linear Time-Varying system. Relationships between the given gramians for nonlinear systems and the standard gramians for both Linear Time-Invariant and Linear Time-Varying systems are established as well as relationships to prior constructions proposed for empirical gramians. Application of the new gramians is illustrated through a samp…
In this work, the empirical-Gramian-based model reduction methods: Empirical poor man's truncated balanced realization, empirical approximate balancing, empirical dominant subspaces, empirical balanced truncation, and empirical balanced gains are compared in a non-parametric and two parametric variants, via ten error measures: Approximate Lebesgue $L_0$, $L_1$, $L_2$, $L_\infty$, Hardy $H_2$, $H_\infty$, Hankel, Hilbert-Schmidt-Hankel, modified induced primal, and modified induced dual norms, for variants of the thermal block model reduction benchmark. This comparison is conducted via a new me…
We discuss balanced truncation model order reduction for large-scale quadratic-bilinear (QB) systems. Balanced truncation for linear systems mainly involves the computation of the Gramians of the system, namely reachability and observability Gramians. These Gramians are extended to a general nonlinear setting in Scherpen (1993), where it is shown that Gramians for nonlinear systems are the solutions of state-dependent nonlinear Hamilton-Jacobi equations. Therefore, they are not only difficult to compute for large-scale systems but also hard to utilize in the model reduction framework. In this …
Max Planck Institute for Dynamics of Complex Technical Systems（马克斯·普朗克复杂技术系统动力学研究所）；Faculty of Mathematics, Otto von Guericke University Magdeburg（马格德堡奥托·冯·格里克大学数学学院）
Considering the use of dynamical systems in practical applications, often only limited regions in the time or frequency domain are of interest. Therefor, it usually pays off to compute local approximations of the used dynamical systems in the frequency and time domain. In this paper, we consider a structure-preserving extension of the frequency- and time-limited balanced truncation methods to second-order dynamical systems. We give a full overview about the first-order limited balanced truncation methods and extend those methods to second-order systems by using the different second-order balan…
Model order reduction (MOR) is often applied to spatially-discretized partial differential equations to reduce their order and hence decrease computational complexity. A reduced system can be obtained, e.g., by time-limited balanced truncation, a method that aims to construct an accurate reduced order model on a given finite time interval $[0, T]$. This particular balancing related MOR technique is studied in this paper. An $L^2_T$-error bound based on the truncated time-limited singular values is proved and is the main result of this paper. The derived error bound converges (as $T\rightarrow …
This paper proposes a data-driven model reduction approach on the basis of noisy data. Firstly, the concept of data reduction is introduced. In particular, we show that the set of reduced-order models obtained by applying a Petrov-Galerkin projection to all systems explaining the data characterized in a large-dimensional quadratic matrix inequality (QMI) can again be characterized in a lower-dimensional QMI. Next, we develop a data-driven generalized balanced truncation method that relies on two steps. First, we provide necessary and sufficient conditions such that systems explaining the data …
We introduce a model reduction approach for linear time-invariant second order systems based on positive real balanced truncation. Our method guarantees asymptotic stability and passivity of the reduced order model as well as the positive definiteness of the mass and stiffness matrices. Moreover, we receive an a priori gap metric error bound. Finally, we show that our method based on positive real balanced truncation preserves the structure of overdamped second order systems.
We present a balanced truncation model reduction approach for a class of nonlinear systems with time-varying and uncertain inputs. First, our approach brings the nonlinear system into quadratic-bilinear~(QB) form via a process called lifting, which introduces transformations via auxiliary variables to achieve the specified model form. Second, we extend a recently developed QB balanced truncation method to be applicable to such lifted QB systems that share the common feature of having a system matrix with zero eigenvalues. We illustrate this framework and the multi-stage lifting transformation …
This paper considers balanced truncation of discrete-time Hankel $k$-positive systems, characterized by Hankel matrices whose minors up to order $k$ are nonnegative. Our main result shows that if the truncated system has order $k$ or less, then it is Hankel totally positive ($\infty$-positive), meaning that it is a sum of first order lags. This result can be understood as a bridge between two known results: the property that the first-order truncation of a positive system is positive ($k=1$), and the property that balanced truncation preserves state-space symmetry. It provides a broad class of…
We introduce an algorithm based on a method of snapshots for computing approximate balanced truncations for discrete-time, stable, linear time-periodic systems. By construction, this algorithm is applicable to very high-dimensional systems, even with very high-dimensional outputs (or, alternatively, very high-dimensional inputs). An example is shown to validate the method.
We show that two widely accepted model reduction techniques, Balanced Truncation and Balanced Singular Perturbation Approximation, can be derived as limiting approximations of a carefully constructed parameterization of Linear Time Invariant (LTI) systems by employing the Model Boundary Approximation Method (MBAM), a recent development in the Physics literature. This unifying framework of these popular model reduction techniques shows that Balanced Truncation and Balanced Singular Perturbation Approximation each correspond to a particular boundary point on a manifold, the "model manifold," whi…
This paper deals with the balanced truncation model reduction of discrete-time, linear time-varying, heterogeneous subsystems interconnected over finite arbitrary directed graphs. The information transfer between the subsystems is subject to a communication latency of one time-step. The presented method guarantees the preservation of the interconnection structure and further allows for its simplification. In addition to truncating temporal states associated with the subsystems, the method allows for the order reduction of spatial states associated with the interconnections between the subsyste…
When solving partial differential equations numerically, usually a high order spatial discretization is needed. Model order reduction (MOR) techniques are often used to reduce the order of spatially-discretized systems and hence reduce computational complexity. A particular MOR technique to obtain a reduced order model (ROM) is balanced truncation (BT). However, if one aims at finding a good ROM on a certain finite time interval only, time-limited BT (TLBT) can be a more accurate alternative. So far, no error bound on TLBT has been proved. In this paper, we close this gap in the theory by prov…
Balanced Truncation of Linear Time-Invariant Systems over Finite-frequency Ranges
Max Planck Institute for Dynamics of Complex Technical Systems（马普复杂技术系统动力学研究所）；School of Mechatronic Engineering and Automation, Shanghai University（上海大学机电工程与自动化学院）
This paper studies model order reduction of multi-agent systems consisting of identical linear passive subsystems, where the interconnection topology is characterized by an undirected weighted graph. Balanced truncation based on a pair of specifically selected generalized Gramians is implemented on the asymptotically stable part of the full-order network model, which leads to a reduced-order system preserving the passivity of each subsystem. Moreover, it is proven that there exists a coordinate transformation to convert the resulting reduced-order model to a state-space model of Laplacian dyna…
When solving partial differential equations numerically, usually a high order spatial discretisation is needed. Model order reduction (MOR) techniques are often used to reduce the order of spatially-discretised systems and hence reduce computational complexity. A particular MOR technique to obtain a reduced order model (ROM) is balanced truncation (BT), a method which has been extensively studied for deterministic linear systems. As so-called type I BT it has already been extended to bilinear equations, an important subclass of nonlinear systems. We provide an alternative generalisation of the…
In this paper, we present a theoretical analysis of the model reduction algorithm for linear switched systems. This algorithm is a reminiscence of the balanced truncation method for linear parameter varying systems. Specifically in this paper, we provide a bound on the approximation error in L2 norm for continuous-time and l2 norm for discrete-time linear switched systems. We provide a system theoretic interpretation of grammians and their singular values. Furthermore, we show that the performance of bal- anced truncation depends only on the input-output map and not on the choice of the state-…
The paper presents a model reduction framework geared towards the analysis and design of systems that switch and oscillate. While such phenomena are ubiquitous in nature and engineering, model reduction methods are not well developed for non-equilibrium behaviors. The proposed framework addresses this need by exploiting recent advances on dominance theory. Classical balanced truncation for linear time-invariant systems is used to develop a dominance-preserving model reduction method for Lure systems, i.e. systems that can be decomposed as the feedback interconnection of a linear system and a s…
We consider model order reduction of a nonlinear cable-mass system modeled by a 1D wave equation with interior damping and dynamic boundary conditions. The system is driven by a time dependent forcing input to a linear mass-spring system at one boundary. The goal of the model reduction is to produce a low order model that produces an accurate approximation to the displacement and velocity of the mass in the nonlinear mass-spring system at the opposite boundary. We first prove that the linearized and nonlinear unforced systems are well-posed and exponentially stable under certain conditions on …
Nonlinear balanced truncation is a model order reduction technique that reduces the dimension of nonlinear systems in a manner that accounts for either open- or closed-loop observability and controllability aspects of the system. Two computational challenges have so far prevented its deployment on large-scale systems: (a) the energy functions required for characterization of controllability and observability are solutions of high-dimensional Hamilton-Jacobi-(Bellman) equations, which have been computationally intractable and (b) the transformations to construct the reduced-order models (ROMs) …
We propose a new framework to design controllers for high-dimensional nonlinear systems. The control is designed through the iterative linear quadratic regulator (ILQR), an algorithm that computes control by iteratively applying the linear quadratic regulator on the local linearization of the system at each time step. Since ILQR is computationally expensive, we propose to first construct reduced-order models (ROMs) of the high-dimensional nonlinear system. We derive nonlinear ROMs via projection, where the basis is computed via balanced truncation (BT) and LQG balanced truncation (LQG-BT). Num…
We analyze a structure-preserving model order reduction technique for delay and stochastic delay equations based on the balanced truncation method and provide a system theoretic interpretation. Transferring error bounds based on Hankel operators to delay systems, we find error estimates for the difference between the dynamics of the full and reduced model. This analysis also yields new error bounds for bilinear systems and stochastic systems with multiplicative noise and non-zero initial states.
We study linear quadratic Gaussian (LQG) control design for linear port-Hamiltonian systems. To this end, we exploit the freedom in choosing the weighting matrices and propose a specific choice which leads to an LQG controller which is port-Hamiltonian and, thus, in particular stable and passive. Furthermore, we construct a reduced-order controller via balancing and subsequent truncation. This approach is closely related to classical LQG balanced truncation and shares a similar a priori error bound with respect to the gap metric. By exploiting the non-uniqueness of the Hamiltonian, we are able…
Reduced-order modeling techniques, including balanced truncation and $\mathcal{H}_2$-optimal model reduction, exploit the structure of linear dynamical systems to produce models that accurately capture the dynamics. For nonlinear systems operating far away from equilibria, on the other hand, current approaches seek low-dimensional representations of the state that often neglect low-energy features that have high dynamical significance. For instance, low-energy features are known to play an important role in fluid dynamics where they can be a driving mechanism for shear-layer instabilities. Neg…
In feedback flow control, one of the challenges is to develop mathematical models that describe the fluid physics relevant to the task at hand, while neglecting irrelevant details of the flow in order to remain computationally tractable. A number of techniques are presently used to develop such reduced-order models, such as proper orthogonal decomposition (POD), and approximate snapshot-based balanced truncation, also known as balanced POD. Each method has its strengths and weaknesses: for instance, POD models can behave unpredictably and perform poorly, but they can be computed directly from …
In this paper, we investigate a large-scale stochastic system with bilinear drift and linear diffusion term. Such high dimensional systems appear for example when discretizing a stochastic partial differential equations in space. We study a particular model order reduction technique called balanced truncation (BT) to reduce the order of spatially-discretized systems and hence reduce computational complexity. We introduce suitable Gramians to the system and prove energy estimates that can be used to identify states which contribute only very little to the system dynamics. When BT is applied the…
We introduce a novel data-driven order reduction method for nonlinear control systems, drawing on recent progress in machine learning and statistical dimensionality reduction. The method rests on the assumption that the nonlinear system behaves linearly when lifted into a high (or infinite) dimensional feature space where balanced truncation may be carried out implicitly. This leads to a nonlinear reduction map which can be combined with a representation of the system belonging to a reproducing kernel Hilbert space to give a closed, reduced order dynamical system which captures the essential i…
A method for finding reduced-order approximations of turbulent flow models is presented. The method preserves bounds on the production of turbulent energy in the sense of the $\curly{L}_2$ norm of perturbations from a notional laminar profile. This is achieved by decomposing the Navier-Stokes system into a feedback arrangement between the linearised system and the remaining, normally neglected, nonlinear part. The linear system is reduced using a method similar to balanced truncation, but preserving bounds on the supply rate. The method involves balancing two algebraic Riccati equations. The b…
We analyze structure-preserving model order reduction methods for Ornstein-Uhlenbeck processes and linear S(P)DEs with multiplicative noise based on balanced truncation. For the first time, we include in this study the analysis of non-zero initial conditions. We moreover allow for feedback-controlled dynamics for solving stochastic optimal control problems with reduced-order models and prove novel error bounds for a class of linear quadratic regulator problems. We provide numerical evidence for the bounds and discuss the application of our approach to enhanced sampling methods from non-equilib…
We consider a Markov process in continuous time with a finite number of discrete states. The time-dependent probabilities of being in any state of the Markov chain are governed by a set of ordinary differential equations, whose dimension might be large even for trivial systems. Here, we derive a reduced ODE set that accurately approximates the probabilities of subspaces of interest with a known error bound. Our methodology is based on model reduction by balanced truncation and can be considerably more computationally efficient than the Finite State Projection Algorithm (FSP) when used for obta…
We study output tracking and disturbance rejection for an Euler-Bernoulli beam with Kelvin-Voigt damping. The system has distributed control and pointwise observation. As our main result we design a finite-dimensional low-order internal model based controller that is based on a spectral Galerkin method and model reduction by Balanced Truncation. The performance of the designed controller is demonstrated with numerical simulations and compared to the performance of a low-gain internal model based controller.
We study $H_\infty$ control design for linear time-invariant port-Hamiltonian systems. By a modification of the two central algebraic Riccati equations, we ensure that the resulting controller will be port-Hamiltonian. Using these modified equations, we proceed to show that a corresponding balanced truncation approach preserves port-Hamiltonian structure. We illustrate the theoretical findings using numerical examples and observe that the chosen representation of the port-Hamiltonian system can have an influence on the approximation qualities of the reduced order model.
We study robust output regulation for parabolic partial differential equations and other infinite-dimensional linear systems with analytic semigroups. As our main results we show that robust output tracking and disturbance rejection for our class of systems can be achieved using a finite-dimensional controller and present algorithms for construction of two different internal model based robust controllers. The controller parameters are chosen based on a Galerkin approximation of the original PDE system and employ balanced truncation to reduce the orders of the controllers. In the second part o…
