In this paper we propose and compare methods for combining system identification (SYSID) and reinforcement learning (RL) in the context of data-driven model predictive control (MPC). Assuming a known model structure of the controlled system, and considering a parametric MPC, the proposed approach simultaneously: a) Learns the parameters of the MPC using RL in order to optimize performance, and b) fits the observed model behaviour using SYSID. Six methods that avoid conflicts between the two optimization objectives are proposed and evaluated using a simple linear system. Based on the simulation results, hierarchical, parallel projection, nullspace projection, and singular value projection achieved the best performance.
For model-based control, an accurate and in its complexity suitable representation of the real system is a decisive prerequisite for high and robust control quality. In a structured step-by-step procedure, a model predictive control (MPC) scheme for a Schunk PowerCube robot is derived. Neweul-M$^2$ provides the necessary nonlinear model in symbolical and numerical form. To handle the heavy online computational burden involved with the derived nonlinear model, a linear time-varying MPC scheme is developed based on linearizing the nonlinear system concerning the desired trajectory and the a prio…
In this work, we combine {Model Predictive Control} (MPC) and Control Barrier Function (CBF) design {methods} to create a hierarchical control law for simultaneous lane-keeping (LK) and obstacle avoidance (OA): at the low level, MPC performs LK via trajectory tracking during nominal operation; and at the high level, different CBF-based safety filters that ensure both LK and OA are designed and compared across some practical scenarios. In particular, we show that Exponential Safety (ESf) and Prescribed-Time Safety (PTSf) filters, which override the MPC control when necessary, result in feasible…
This paper investigates controller identification given data from a Model Predictive Controller (MPC) with constraints. We propose an approach for learning MPC that explicitly uses the gradient information in the training process. This is motivated by the observation that recent differentiable convex optimization MPC solvers can provide both the optimal feedback law from the state to control input as well as the corresponding gradient. As a proof of concept, we apply this approach to explicit MPC (eMPC), for which the feedback law is a piece-wise affine function of the state, but the number of…
Adaptive model predictive control (MPC) methods using set-membership identification to reduce parameter uncertainty are considered in this work. Strong duality is used to reformulate the set-membership equations exactly within the MPC optimization. A predicted worst-case cost is then used to enable performance-oriented exploration. The proposed approach guarantees robust constraint satisfaction and recursive feasibility. It is shown that method can be implemented using homothetic tube and flexible tube parameterizations of state tubes, and a simulation study demonstrates performance improvemen…
A dual adaptive model predictive control (MPC) algorithm is presented for linear, time-invariant systems subject to bounded disturbances and parametric uncertainty in the state-space matrices. Online set-membership identification is performed to reduce the uncertainty and thus control affects both the informativity of identification and the system's performance. The main contribution of the paper is to include this dual effect in the MPC optimization problem using a predicted worst-case cost in the objective function. This allows the controller to perform active exploration, that is, the contr…
In pedestrian-dense traffic scenarios, an autonomous vehicle may have to safely drive through a crowd of pedestrians while the vehicle tries to keep the desired speed as much as possible. This requires a model that can predict the motion of crowd pedestrians and a method for the vehicle to predictively adjust its speed. In this study, the model-based predictive control (MPC) was combined with a social-force based vehicle-crowd interaction (VCI) model to regulate the longitudinal speed of the autonomous vehicle. The predictive feature of the VCI model can be precisely utilized by the MPC. A cri…
The demand for faster protection algorithms is growing due to the increasingly faster dynamics in the system. The majority of existing algorithms require empirically selected set-points, which may reduce sensitivity to internal faults and cause security problems. This paper addresses these challenges by proposing a settingless time-domain unit protection algorithm for medium-voltage lines. The main idea of the algorithm is to identify which model of a protected line, i.e. healthy or with an internal fault, is more consistent with the input measurements. This is done by solving a number of smal…
We present a solution for modeling and online identification for heating, ventilation, and air conditioning (HVAC) control in buildings. Our approach comprises: (a) a resistance-capacitance (RC) model based on first order energy balance for deriving the zone temperature dynamics, and (b) a neural network for modeling HVAC dynamics. State estimation and model identification are simultaneously performed using nonlinear moving horizon estimation (MHE) with physical constraints for system states. We leverage the identified model in model predictive control (MPC) for occupant comfort satisfaction a…
The use of Recurrent Neural Networks (RNNs) for system identification has recently gathered increasing attention, thanks to their black-box modeling capabilities.Albeit RNNs have been fruitfully adopted in many applications, only few works are devoted to provide rigorous theoretical foundations that justify their use for control purposes. The aim of this paper is to describe how stable Gated Recurrent Units (GRUs), a particular RNN architecture, can be trained and employed in a Nonlinear MPC framework to perform offset-free tracking of constant references with guaranteed closed-loop stability.…
VisioPath: Vision-Language Enhanced Model Predictive Control for Safe Autonomous Navigation in Mixed Traffic
System Engineering Program, Cornell University（Cornell大学系统工程项目）；School of Civil and Environmental Engineering, Cornell University（Cornell大学土木与环境工程学院）；School of Electrical and Computer Engineering, Cornell University（Cornell大学电气与计算机工程学院）
