This paper investigates controller identification given data from a Model Predictive Controller (MPC) with constraints. We propose an approach for learning MPC that explicitly uses the gradient information in the training process. This is motivated by the observation that recent differentiable convex optimization MPC solvers can provide both the optimal feedback law from the state to control input as well as the corresponding gradient. As a proof of concept, we apply this approach to explicit MPC (eMPC), for which the feedback law is a piece-wise affine function of the state, but the number of pieces grows rapidly with the state dimension. Controller identification can here be used to find an approximate lower complexity functional approximation of the controller. The eMPC is modelled with a Neural Network (NN) with Rectified Linear Units (ReLUs), since such NN can represent any piece-wise affine function. A motivation is to replace on-line solvers with neural networks to implement MPC and to simplify the evaluation of the function in larger input dimensions. We also study experimental design and model evaluation in this framework, and propose a hit and run sampling algorithm for input design. The proposed algorithm are illustrated and numerically evaluated on a second order MPC problem.
On the wave of recent advances in data-driven predictive control, we present an explicit predictive controller that can be constructed from a batch of input/output data only. The proposed explicit law is build upon a regularized implicit data-driven predictive control problem, so as to guarantee the uniqueness of the explicit predictive controller. As a side benefit, the use of regularization is shown to improve the capability of the explicit law in coping with noise on the data. The effectiveness of the retrieved explicit law and the repercussions of regularization on noise handling are analy…
In this paper, a neural network predictive controller (NNPC) is proposed to control a buck converter. Conventional controllers such as proportional integral (PI) or proportional integral derivative (PID) are designed based on the linearized small signal model near the operating point. Therefore, the performance of the controller in the start up, load change, or reference change is not optimal since the system model changes by changing the operating point. The neural network predictive controller optimally controls the buck converter by following the concept of the traditional model predictive …
The Unscented Transform which is the basis of the Unscented Kalman Filter, UKF, is used here to develop a novel predictive controller for non-linear plants, called the Unscented Transform Controller, UTC. The UTC can be seen as the dual of the UKF, the same way as the LQG regulator and the Kalman Filter are related. The UTC is demonstrated on the control of complex maneuvers in free fall of a virtual skydiver the model of which was verified in wind tunnel and free fall experiments.
In this paper, we propose a data-driven approach to derive explicit predictive control laws, without requiring any intermediate identification step. The keystone of the presented strategy is the exploitation of available priors on the control law, coming from model-based analysis. Specifically, by leveraging on the knowledge that the optimal predictive controller is expressed as a piecewise affine (PWA) law, we directly optimize the parameters of such an analytical controller from data, instead of running an on-line optimization problem. As the proposed method allows us to automatically retrie…
In this paper, we deal with data-driven predictive control of linear time-invariant (LTI) systems. Specifically, we show for the first time how explicit predictive laws can be learnt directly from data, without needing to identify the system to control. To this aim, we resort to the Willems' fundamental lemma and we derive the explicit formulas by suitably elaborating the constrained optimization problem under investigation. The resulting optimal controller turns out to be a piecewise affine system coinciding with the solution of the original model-based problem in case of noiseless data. Such…
This paper presents a data-driven approach to the design of predictive controllers. The prediction matrices utilized in standard model predictive control (MPC) algorithms are typically constructed using knowledge of a system model such as, state-space or input-output models. Instead, we directly estimate the prediction matrices relating future outputs with current and future inputs from measured data, off-line. On-line, the developed data--driven predictive controller reduces to solving a quadratic program with a similar structure and complexity as linear MPC. Additionally, we develop a new pr…
In this paper, we propose a framework for the longitudinal control of connected and automated vehicles traveling in mixed traffic consisting of connected and non-connected human-driven vehicles. Reactive and predictive controllers are proposed. Reactive controllers are given by explicit feedback control laws. In predictive controllers, the control input is optimized in a receding-horizon fashion, which depends on the predictions of motions of preceding vehicles. Beyond-line-of-sight information is obtained via vehicle-to-vehicle (V2V) communication, and is utilized in the proposed reactive and…
In this paper, a neural network predictive controller is proposed to regulate the active and the reactive power delivered to the grid generated by a three-phase virtual inertia-based inverter. The concept of the conventional virtual synchronous generator (VSG) is discussed, and it is shown that when the inverter is connected to non-inductive grids, the conventional PI-based VSGs are unable to perform acceptable tracking. The concept of the neural network predictive controller is also discussed to replace the traditional VSGs. This replacement enables inverters to perform in both inductive and …
This paper presents a new Lyapunov-based nonlinear model predictive controller (LNMPC) for the attitude control problem of unmanned aerial vehicles (UAVs), which is essential for their functioning operation. The controller is designed based on a quadratic cost function integrating UAV dynamics and system constraints. An additional contraction constraint is then introduced to ensure closed-loop system stability. That constraint is fulfilled via a Lyapunov function derived from a sliding mode controller (SMC). The feasibility and stability of the LNMPC are finally proved. Simulation and comparis…
Due to the fluctuating nature of the wind and the increasing use of wind energy as a power source, wind power will have an increasing negative influence on the stability of the power grid. In this paper, a model predictive control strategy is introduced that not only stabilizes the power produced by wind farms, but also creates the possibility to perform power reference tracking with wind farms. With power reference tracking, it is possible for grid operators to adapt the power production to a change in the power demand and to counteract fluctuations that are introduced by other power generato…
In order to enhance the performance of cyber-physical systems, this paper proposes the integrated de-sign of distributed controllers for distributed plants andthe control of the communication network. Conventionaldesign methods use static interfaces between both enti-ties and therefore rely on worst-case estimations of com-munication delay, often leading to conservative behaviorof the overall system. By contrast, the present approachestablishes a robust distributed model-predictive controlscheme, in which the local subsystem controllers oper-ate under the assumption of a variable communication…
Vehicle stability control systems are important components of active safety systems for road transport. The problem of vehicle lateral stability control is addressed in this paper using active front wheel steering and individual braking. Vehicle lateral stability control means keeping the vehicle yaw rate and the vehicle side slip angle in desired values. For this reason, a model-based controller is designed. The desired yaw rate is obtained from the single track vehicle model and the desired side slip angle is chosen as zero. Controller design consists of two parts, lower and upper controller…
In this paper, we present a data-driven Model Predictive Controller that leverages a Gaussian Process to generate optimal motion policies for connected autonomous vehicles in regions with uncertainty in the wireless channel. The communication channel between the vehicles of a platoon can be easily influenced by numerous factors, e.g. the surrounding environment, and the relative states of the connected vehicles, etc. In addition, the trajectories of the vehicles depend significantly on the motion policies of the preceding vehicle shared via the wireless channel and any delay can impact the saf…
This paper presents a systematic method for the selection of the Model Predictive Control (MPC) stage cost. We match the MPC feedback law to a proportional-integral (PI) controller, which we efficiently tune by high-performance Monte Carlo (MC) simulation. The PI tuning offers a wide range of tuning possibilities that is then inherited by the MPC design. The MC simulation tuning of the PI controller is based on the minimization of two different objectives; 1) the 2-norm tracking error, and 2) a bi-objective consisting of the 2-norm tracking error and a 2-norm input rate of movement penalty. We…
The high thermal efficiency and reliability of the compression-ignition engine makes it the first choice for many applications. For this to continue, a reduction of the pollutant emissions is needed. One solution is the use of machine learning (ML) and model predictive control (MPC) to minimize emissions and fuel consumption, without adding substantial computational cost to the engine controller. ML is developed in this paper for both modeling engine performance and emissions and for imitating the behaviour of an Linear Parameter Varying (LPV) MPC. Using a support vector machine-based linear p…
This article explores the optimization of plant characteristics and controller parameters for electrified mobility. Electrification of mobile transportation systems, such as automobiles and aircraft, presents the ability to improve key performance metrics such as efficiency and cost. However, the strong bidirectional coupling between electrical and thermal dynamics within new components creates integration challenges, increasing component degradation and reducing performance. Diminishing these issues requires novel plant designs and control strategies. The electrified mobility literature provi…
A new strategy is proposed to control interior permanent magnet generators in dc microgrids interfaced through an active rectifier. The controller design is based on the decomposition of the system dynamics into slow and fast modes using singular perturbation theory. An inner current controller is developed based on output regulation techniques and an outer voltage controller is proposed using Nonlinear Model Predictive Control (NMPC). The NMPC regulates the dc bus voltage and minimizes the ac side losses. Simulation results are then presented based on realistic conditions for aircraft power s…
A distributed model predictive control scheme is developed for tracking piecewise constant references where the terminal set is reconfigured online, whereas the terminal controller is computed offline. Unlike many standard existing schemes, this scheme yields large feasible regions without performing offline centralized computations. Although the resulting optimal control problem (OCP) is a semidefinite program (SDP), an SDP scalability method based on diagonal dominance is used to approximate the derived SDP by a second-order cone program. The OCPs of the proposed scheme and its approximation…
Stabilizing multi-steered articulated vehicles in backward motion is a complex task for any human driver. Unless the vehicle is accurately steered, its structurally unstable joint-angle kinematics during reverse maneuvers can cause the vehicle segments to fold and enter a jack-knife state. In this work, a model predictive path-following controller is proposed enabling automatic low-speed steering control of multi-steered articulated vehicles, comprising a car-like tractor and an arbitrary number of trailers with passive or active steering. The proposed path-following controller is tailored to …
We present a delay-compensating control method that transforms exponentially stabilizing controllers for an undelayed system into a sample-based predictive controller with numerical integration. Our method handles both first-order and transport delays in actuators and trades-off numerical accuracy with computation delay to guaranteed stability under hardware limitations. Through hybrid stability analysis and numerical simulation, we demonstrate the efficacy of our method from both theoretical and simulation perspectives.
This paper proposes an offline control algorithm, called Recurrent Model Predictive Control (RMPC), to solve large-scale nonlinear finite-horizon optimal control problems. It can be regarded as an explicit solver of traditional Model Predictive Control (MPC) algorithms, which can adaptively select appropriate model prediction horizon according to current computing resources, so as to improve the policy performance. Our algorithm employs a recurrent function to approximate the optimal policy, which maps the system states and reference values directly to the control inputs. The output of the lea…
Predictive control is frequently used for control problems involving constraints. Being an optimization based technique utilizing a user specified so-called stage cost, performance properties, i.e., bounds on the infinite horizon accumulated stage cost, aside closed-loop stability are of interest. To achieve good performance and to influence the region of attraction associated with the prediction horizon, the terminal cost of the predictive controller's optimization objective is a key design factor. Approximate dynamic programming refers to one particular approximation paradigm that pursues it…
Vanderbilt University（范德堡大学）；Institute of Software Integrated Systems, Vanderbilt University（范德堡大学软件集成系统研究所）
A desirable property in fault-tolerant controllers is adaptability to system changes as they evolve during systems operations. An adaptive controller does not require optimal control policies to be enumerated for possible faults. Instead it can approximate one in real-time. We present two adaptive fault-tolerant control schemes for a discrete time system based on hierarchical reinforcement learning. We compare their performance against a model predictive controller in presence of sensor noise and persistent faults. The controllers are tested on a fuel tank model of a C-130 plane. Our experimen…
This paper presents an online-capable controller for the energy management system of a parallel hybrid electric vehicle based on model predictive control. Its task is to minimize the vehicle's fuel consumption along a predicted driving mission by calculating the distribution of the driver's power request between the electrical and the combustive part of the powertrain, and by choosing the driving mode, which depends on the vehicle's clutch state. The inclusion of the clutch state in a model predictive control structure is not trivial because the underlying optimization problem becomes a mixed-…
We propose a tube-based guaranteed cost model predictive controller considering a homothetic formulation for constrained linear systems subject to multiplicative structured norm-bounded uncertainties. It provides an upper bound to the general min-max model predictive control. The invariance property of the proposed tube holds for any arbitrary scaling. It yields a second-order cone programming problem which is less computationally expensive than standard semi-definite programming problems. We also present a numerical example with a comparative study among the proposed approach, an open-loop gu…
Machine learning (ML) and a nonlinear model predictive controller (NMPC) are used in this paper to minimize the emissions and fuel consumption of a compression ignition engine. In this work machine learning is applied in two methods. In the first application, ML is used to identify a model for implementation in model predictive control optimization problems. In the second application, ML is used as a replacement of the NMPC where the ML controller learns the optimal control action by imitating or mimicking the behavior of the model predictive controller. In this study, a deep recurrent neural …
This paper proposes a Robust Safe Control Architecture (RSCA) for safe-decision making. The system to be controlled is a vehicle in the presence of bounded disturbances. The RSCA consists of two parts: a Supervisor MPC and a Controller MPC. Both the Supervisor and the Controller are tube MPCs (TMPCs). The Supervisor MPC provides a safety certificate for an operating controller and a backup control input in every step. After an unsafe action by the operating controller is predicted, the Controller MPC takes over the system. In this paper, a method for the computation of a terminal set is propos…
This paper proposes a hybrid Gaussian process (GP) approach to robust economic model predictive control under unknown future disturbances in order to reduce the conservatism of the controller. The proposed hybrid GP is a combination of two well-known methods, namely, kernel composition and nonlinear auto-regressive. A switching mechanism is employed to select one of these methods for disturbance prediction after analyzing the prediction outcomes. The hybrid GP is intended to detect not only patterns but also unexpected behaviors in the unknown disturbances by using past disturbance measurement…
This paper presents an economic model predictive controller, under the assumption that the only measurable signal of the plant is the economic cost to be minimized. In order to forecast the evolution of this economic cost for a given input trajectory, a prediction model with a NARX structure, the so-called oracle, is proposed. Sufficient conditions to ensure the existence of such oracle are studied, proving that it can be derived for a general nonlinear system if the economic cost function is a Morse function. Based on this oracle, economic model predictive controllers are proposed, and their …
In this technical note we analyse the performance improvement and optimality properties of the Learning Model Predictive Control (LMPC) strategy for linear deterministic systems. The LMPC framework is a policy iteration scheme where closed-loop trajectories are used to update the control policy for the next execution of the control task. We show that, when a Linear Independence Constraint Qualification (LICQ) condition holds, the LMPC scheme guarantees strict iterative performance improvement and optimality, meaning that the closed-loop cost evaluated over the entire task converges asymptotica…
In this article the implementation of a controller and specifically of a Model Predictive Controller (MPC) on an Edge Computing device, for controlling the trajectory of an Unmanned Aerial Vehicle (UAV) model, is examined. MPC requires more computation power in comparison to other controllers, such as PID or LQR, since it use cost functions, optimization methods and iteratively predicts the output of the system and the control commands for some determined steps in the future (prediction horizon). Thus, the computation power required depends on the prediction horizon, the complexity of the cost…
