While subspace identification methods (SIMs) are appealing due to their simple parameterization for MIMO systems and robust numerical realizations, a comprehensive statistical analysis of SIMs remains an open problem, especially in the non-asymptotic regime. In this work, we provide a finite sample analysis for a class of SIMs, which reveals that the convergence rates for estimating Markov parameters and system matrices are $\mathcal{O}(1/\sqrt{N})$, in line with classical asymptotic results. Based on the observation that the model format in classical SIMs becomes non-causal because of a projection step, we choose a parsimonious SIM that bypasses the projection step and strictly enforces a causal model to facilitate the analysis, where a bank of ARX models are estimated in parallel. Leveraging recent results from finite sample analysis of an individual ARX model, we obtain an overall error bound of an array of ARX models and proceed to derive error bounds for system matrices via robustness results for the singular value decomposition.
In this paper, we establish a unified framework for subspace identification (SID) of linear parameter-varying (LPV) systems to estimate LPV state-space (SS) models in innovation form. This framework enables us to derive novel LPV SID schemes that are extensions of existing linear time-invariant (LTI) methods. More specifically, we derive the open-loop, closed-loop, and predictor-based data-equations, an input-output surrogate form of the SS representation, by systematically establishing an LPV subspace identification theory. We show the additional challenges of the LPV setting compared to the …
This paper proposes a new methodology for subspace identification of linear time-periodic (LTP) systems with periodic inputs. This method overcomes the issues related to the computation of frequency response of LTP systems by utilizing the frequency response of the time-lifted system with linear time-invariant structure instead. The response is estimated with an ensemble of input-output data with periodic inputs. This allows the frequency-domain subspace identification technique to be extended to LTP systems. The time-aliased periodic impulse response can then be estimated and the order-reveal…
Model estimates obtained from traditional subspace identification methods may be subject to significant variance. This elevated variance is aggravated in the cases of large models or of a limited sample size. Common solutions to reduce the effect of variance are regularized estimators, shrinkage estimators and Bayesian estimation. In the current work we investigate the latter two solutions, which have not yet been applied to subspace identification. Our experimental results show that our proposed estimators may reduce the estimation risk up to $40\%$ of that of traditional subspace methods.
The subspace method is one of the mainstream system identification method of linear systems, and its basic idea is to estimate the system parameter matrices by projecting them into a subspace related to input and output. However, most of the existing subspace methods cannot have the statistic performance guaranteed since the lack of closed-form expression of the estimation. Meanwhile, traditional subspace methods cannot deal with the uncertainty of the noise, and thus stable identification results cannot be obtained. In this paper, we propose a novel improved subspace method from the perspecti…
We present an algorithmic framework for the identification of candidate invariant subspaces for switched linear systems. Namely, the framework allows to compute an orthonormal basis in which the matrices of the system are close to block-triangular matrices, based on a finite set of observed one-step trajectories and with a priori confidence level. The link between the existence of an invariant subspace and a common block-triangularization of the system matrices is well known. Under some assumptions on the system, one can also infer the existence of an invariant subspace when the matrices are c…
Operational Modal Analysis (OMA) provides essential insights into the structural dynamics of an Offshore Wind Turbine (OWT). In these dynamics, damping is considered an especially important parameter as it governs the magnitude of the response at the natural frequencies. Violation of the stationary white noise excitation requirement of classical OMA algorithms has troubled the identification of operational OWTs due to harmonic excitation caused by rotor rotation. Recently, a novel algorithm was presented that mitigates harmonics by estimating a harmonic subsignal using a Kalman filter and orth…
Subspace identification (SID) has been widely used in system identification and control fields since it can estimate system models only relying on the input and output data by reliable numerical operations such as singular value decomposition (SVD). However, high-dimension Hankel matrices are involved to store these data and used to obtain the system models, which increases the computation amount of SID and leads SID not suitable for the large-scale or real-time identification tasks. In this paper, a novel fast SID method based on cloud workflow processing and container technology is proposed …
Data-driven modeling and control of temperature dynamics in mechatronics systems and industrial processes are challenging control engineering problems. This is mainly because the temperature dynamics is inherently infinite-dimensional, nonlinear, spatially distributed, and coupled with other physical processes. Furthermore, the dominant time constants are usually long, implying that in practice due to various economic and time constraints, we can only collect a relatively small number of data samples that can be used for data-driven modeling. Finally, since sensing and actuation of temperature…
This paper presents unifying results for subspace identification (SID) and dynamic mode decomposition (DMD) for autonomous dynamical systems. We observe that SID seeks to solve an optimization problem to estimate an extended observability matrix and a state sequence that minimizes the prediction error for the state-space model. Moreover, we observe that DMD seeks to solve a rank-constrained matrix regression problem that minimizes the prediction error of an extended autoregressive model. We prove that existence conditions for perfect (error-free) state-space and low-rank extended autoregressiv…
Eindhoven University of Technology（埃因霍温理工大学）；Institute for Computer Science and Control（计算机科学与控制研究所）
Continuous-time (CT) modeling has proven to provide improved sample efficiency and interpretability in learning the dynamical behavior of physical systems compared to discrete-time (DT) models. However, even with numerous recent developments, the CT nonlinear state-space (NL-SS) model identification problem remains to be solved in full, considering common experimental aspects such as the presence of external inputs, measurement noise, latent states, and general robustness. This paper presents a novel estimation method that addresses all these aspects and that can obtain state-of-the-art result…
In this paper, we investigate the feasibility of using subspace system identification techniques for estimating transient Structural-Thermal-Optical Performance (STOP) models of reflective optics. As a test case, we use a Newtonian telescope structure. This work is motivated by the need for the development of model-based data-driven techniques for prediction, estimation, and control of thermal effects and thermally-induced wavefront aberrations in optical systems, such as ground and space telescopes, optical instruments operating in harsh environments, optical lithography machines, and optical…
Stable Linear Subspace Identification: A Machine Learning Approach
Swiss Federal Laboratories for Materials Science and Technology (Empa)（瑞士联邦材料科学与技术研究所（Empa））；Swiss Federal Institute of Technology Lausanne (EPFL)（洛桑联邦理工学院（EPFL））
One of the primary challenges of system identification is determining how much data is necessary to adequately fit a model. Non-asymptotic characterizations of the performance of system identification methods provide this knowledge. Such characterizations are available for several algorithms performing open-loop identification. Often times, however, data is collected in closed-loop. Application of open-loop identification methods to closed-loop data can result in biased estimates. One method used by subspace identification techniques to eliminate these biases involves first fitting a long-hori…
The robust disturbance rejection controller has been the subject of intensive research due to its undeniable importance for automation. Modern control theory tends to use model-based approaches versus model-free approaches, especially when it comes to highly modern applications. The backbone of the dissertation is based on the systematic modeling of dynamic systems and the development of advanced control methods. Accordingly, the dissertation begins with the investigation of nonlinearities in dynamic systems. The extension of classic subspace algorithms for linear systems in the frequency doma…
