We propose a hierarchical learning architecture for predictive control in unknown environments. We consider a constrained nonlinear dynamical system and assume the availability of state-input trajectories solving control tasks in different environments. A parameterized environment model generates state constraints specific to each task, which are satisfied by the stored trajectories. Our goal is to find a feasible trajectory for a new task in an unknown environment. From stored data, we learn strategies in the form of target sets in a reduced-order state space. These strategies are applied to the new task in real-time using a local forecast of the new environment, and the resulting output is used as a terminal region by a low-level receding horizon controller. We show how to i) design the target sets from past data and then ii) incorporate them into a model predictive control scheme with shifting horizon that ensures safety of the closed-loop system when performing the new task. We prove the feasibility of the resulting control policy, and verify the proposed method in a robotic path planning application.
The aim of this paper is to propose a new data-driven control scheme for multi-input-multi-output linear time-invariant systems whose system model are completely unknown. Using a non-minimal input-output realization, the proposed method can be applied to the case where the system order is unknown, provided that its upper bound is known. A workaround against measurement noise is proposed and it is shown through simulation study that the proposed method is superior to the conventional methods when dealing with input/output data corrupted by measurement noise.
We present differentiable predictive control (DPC) as a deep learning-based alternative to the explicit model predictive control (MPC) for unknown nonlinear systems. In the DPC framework, a neural state-space model is learned from time-series measurements of the system dynamics. The neural control policy is then optimized via stochastic gradient descent approach by differentiating the MPC loss function through the closed-loop system dynamics model. The proposed DPC method learns model-based control policies with state and input constraints, while supporting time-varying references and constrai…
This paper investigates the data-driven predictive control problems for a class of continuous-time industrial processes with completely unknown dynamics. The proposed approach employs the data-driven technique to get the system matrices online, using input-output measurements. Then, a model-free predictive control approach is designed to implement the receding-horizon optimization and realize the reference tracking. Feasibility of the proposed algorithm and stability of the closed-loop control systems are analyzed, respectively. Finally, a simulation example is provided to demonstrate the effe…
This paper addresses the problem of management and coordination of energy resources in a typical microgrid, including smart buildings as flexible loads, energy storages, and renewables. The overall goal is to provide a comprehensive and innovative framework to maximize the overall benefit, still accounting for possible requests to change the load profile coming from the grid and leaving every single building or user to balance between servicing those requests and satisfying his own comfort levels. The user involvement in the decision-making process is granted by a management and control soluti…
Abstract-In this manuscript, model predictive control for class of discrete fuzzy large-scale systems subjected to bounded time-varying delay and disturbances is studied. The considered method is Razumikhin for time-varying delay large-scale systems, in which it includes a Lyapunov function associated with the original non-augmented state space of system dynamics in comparison with the Krasovskii method. As a rule, the Razumikhin method has a perfect potential to avoid the inherent complexity of the Krasovskii method especially in the presence of large delays and disturbances. The considered l…
In this paper, we use a nonlinear hierarchical model predictive control (MPC) to stabilize the Segway robot. We also use hardware in the loop (HIL) simulation in order to model the delay response of the wheels' motor and verify the control algorithm. In Two-Wheeled Personal Transportation Robots (TWPTR), changing the center of mass location and value, the nonlinearity of the equations, and the dynamics of the system are topics complicating the control problem. A nonlinear MPC predicts the dynamics of the system and solves the control problem efficiently, but requires the exact information of t…
We present a solution for modeling and online identification for heating, ventilation, and air conditioning (HVAC) control in buildings. Our approach comprises: (a) a resistance-capacitance (RC) model based on first order energy balance for deriving the zone temperature dynamics, and (b) a neural network for modeling HVAC dynamics. State estimation and model identification are simultaneously performed using nonlinear moving horizon estimation (MHE) with physical constraints for system states. We leverage the identified model in model predictive control (MPC) for occupant comfort satisfaction a…
In this paper, the model predictive control is designed for an interval type-2 Takagi-Sugeno (T-S) system with unknown time-varying delay in state and input vectors. The time-varying delay is a weird phenomenon that is appeared in almost all systems. It can make many problems and instability while the system is working. In this paper, the time-varying delay is considered in both states and input vectors and is the sensible difference between the proposed method here and previous algorithms, besides, it is unknown but bounded. To solve the problem, the Razumikhin approach is applied to the prop…
Algorithms for motion planning in unknown environments are generally limited in their ability to reason about the structure of the unobserved environment. As such, current methods generally navigate unknown environments by relying on heuristic methods to choose intermediate objectives along frontiers. We present a unified method that combines map prediction and motion planning for safe, time-efficient autonomous navigation of unknown environments by dynamically-constrained robots. We propose a data-driven method for predicting the map of the unobserved environment, using the robot's observatio…
Gaussian Process Model Predictive Control of Unknown Nonlinear Systems
School of Engineering and Advanced Technology, Massey University（梅西大学工程与先进技术学院）；Department of Information Technology and Software Engineering, Auckland University of Technology（奥克兰理工大学信息技术与软件工程系）
Velocity-Form Data-Enabled Predictive Control of Soft Robots under Unknown External Payloads
Department of Mechanical Engineering, Michigan State University（机械工程系，密歇根州立大学）；Department of Mechanical Engineering, University of California Riverside（机械工程系，加州大学河滨分校）；Department of Electrical and Computer Engineering, Michigan State University（电气与计算机工程系，密歇根州立大学）；Department of Electrical and Computer Engineering, University of Michigan（电气与计算机工程系，密歇根大学）
Otto von Guericke University（奥托·冯·格里克大学）；German Aerospace Center (DLR)（德国航空航天中心（DLR））；Technical University of Darmstadt（达姆施塔特工业大学）
Planning and control for autonomous vehicles usually are hierarchical separated. However, increasing performance demands and operating in highly dynamic environments requires an frequent re-evaluation of the planning and tight integration of control and planning to guarantee safety. We propose an integrated hierarchical predictive control and planning approach to tackle this challenge. Planner and controller are based on the repeated solution of moving horizon optimal control problems. The planner can choose different low-layer controller modes for increased flexibility and performance instead…
This article proposes a hierarchical learning architecture for safe data-driven control in unknown environments. We consider a constrained nonlinear dynamical system and assume the availability of state-input trajectories solving control tasks in different environments. In addition to task-invariant system state and input constraints, a parameterized environment model generates task-specific state constraints, which are satisfied by the stored trajectories. Our goal is to use these trajectories to find a safe and high-performing policy for a new task in a new, unknown environment. We propose u…
In this work, we propose a distributionally robust stochastic model predictive control (DR-SMPC) algorithm to address the problem of two-sided chance constrained discrete-time linear system corrupted by additive noise. The prevalent mechanism to cope with two-sided chance constraints is the so-called risk allocation approach, which conservatively approximates the two-sided chance constraints with two single chance constraints by applying the Boole's inequality. In this proposed DR-SMPC framework, an exact tractable second-order cone (SOC) approach is adopted to abstract the two-sided chance co…
The optimal control of a water reservoir systems represents a challenging problem, due to uncertain hydrologic inputs and the need to adapt to changing environment and varying control objectives. In this work, we propose a real-time learning-based control strategy based on a hierarchical predictive control architecture. Two control loops are implemented: the inner loop is aimed to make the overall dynamics similar to an assigned linear through data-driven control design, then the outer economic model-predictive controller compensates for model mismatches, enforces suitable constraints, and boo…
Online transient stability assessment (TSA) is essential for secure and stable power system operations. The growing number of Phasor Measurement Units (PMUs) brings about massive sources of data that can enhance online TSA. However, conventional data-driven methods require large amounts of transient data to correctly assess the transient stability state of a system. In this paper, a new data-driven TSA approach is developed for TSA with fewer data compared to the conventional methods. The data reduction is enabled by learning the dynamic behaviors of the historical transient data using generat…
Hierarchical-type Model Predictive Control and Experimental Evaluation for a Water-Hydraulic Artificial Muscle with Direct Data-Driven Adaptive Model Matching
A Hierarchical Stochastic Model Predictive Control Framework for Integrated Request-aware Charge Scheduling and Service Allocation
Univ. Grenoble Alpes, CNRS, Grenoble INP（格勒诺布尔阿尔卑斯大学、法国国家科学研究中心、格勒诺布尔理工学院）；College of Computing and Data Science, Nanyang Technological University（南洋理工大学计算与数据科学学院）
We provide a comprehensive review and practical implementation of a recently developed model predictive control (MPC) framework for controlling unknown systems using only measured data and no explicit model knowledge. Our approach relies on an implicit system parametrization from behavioral systems theory based on one measured input-output trajectory. The presented MPC schemes guarantee closed-loop stability for unknown linear time-invariant (LTI) systems, even if the data are affected by noise. Further, we extend this MPC framework to control unknown nonlinear systems by continuously updating…
The problem of real-time control and optimization of components' routing in discrete manufacturing plants, where distinct items must undergo a sequence of jobs, is considered. This problem features a large number of discrete control inputs and the presence of temporal-logic constraints. A new approach is proposed, adopting a shift of perspective with respect to previous contributions, from a Eulerian system model that tracks the state of plant nodes, to a Lagrangian model that tracks the state of each part being processed. The approach features a hierarchical structure. At a higher level, a pr…
Distributed switched large-scale systems are composed by dynamically coupled subsystems, in which interactions among subsystems vary over time according to an exogenous input signal named switching signal. In this paper, we present a distributed robust switched model-based predictive control (DSwMPC) to control such systems that are subject to local state and input constraints. The proposed method guarantees stabilizing the origin of the whole closed-loop system and ensures the constraints satisfaction in the presence of an unknown switching signal. In the distributed model-based predictive co…
This paper proposes a hybrid Gaussian process (GP) approach to robust economic model predictive control under unknown future disturbances in order to reduce the conservatism of the controller. The proposed hybrid GP is a combination of two well-known methods, namely, kernel composition and nonlinear auto-regressive. A switching mechanism is employed to select one of these methods for disturbance prediction after analyzing the prediction outcomes. The hybrid GP is intended to detect not only patterns but also unexpected behaviors in the unknown disturbances by using past disturbance measurement…
Reinforcement Learning Compensated Model Predictive Control for Off-road Driving on Unknown Deformable Terrain
Department of Automotive Engineering, Clemson University（汽车工程系，克莱姆森大学）；Ground Vehicle Systems Center, U.S. Army Combat Capabilities Development Command（地面车辆系统中心，美国陆军作战能力发展指挥部）
Robust adaptive model predictive control (RAMPC) is a novel control method that combines robustness guarantees with respect to unknown parameters and bounded disturbances into a model predictive control scheme. However, RAMPC has so far only been developed in theory. The goal of this paper is to apply RAMPC to a physical quadrotor experiment. To the best of our knowledge this is the first time that RAMPC has been applied in practice using a state space formulation. In doing so, we highlight important practical challenges such as computation of $λ$-contractive polytopes and dealing with measure…
University of California at Berkeley（加州大学伯克利分校）；California Institute of Technology（加州理工学院）
We present a Model Predictive Control (MPC) strategy for unknown input-affine nonlinear dynamical systems. A non-parametric method is used to estimate the nonlinear dynamics from observed data. The estimated nonlinear dynamics are then linearized over time varying regions of the state space to construct an Affine Time Varying (ATV) model. Error bounds arising from the estimation and linearization procedure are computed by using sampling techniques. The ATV model and the uncertainty sets are used to design a robust Model Predictive Control (MPC) problem which guarantees safety for the unknown s…
Bipedal Robust Walking on Uneven Footholds: Piecewise Slope LIPM with Discrete Model Predictive Control
Faculty of Computing, Harbin Institute of Technology（哈尔滨工业大学计算学部）；State Key Laboratory of Robotics and System, Harbin Institute of Technology（哈尔滨工业大学机器人技术与系统国家重点实验室）
We present a data-driven model predictive control scheme for chance-constrained Markovian switching systems with unknown switching probabilities. Using samples of the underlying Markov chain, ambiguity sets of transition probabilities are estimated which include the true conditional probability distributions with high probability. These sets are updated online and used to formulate a time-varying, risk-averse optimal control problem. We prove recursive feasibility of the resulting MPC scheme and show that the original chance constraints remain satisfied at every time step. Furthermore, we show…
Adaptive Legged Locomotion via Online Learning for Model Predictive Control
Department of Aerospace Engineering, University of Michigan（密歇根大学航空航天工程系）；Institute for Robotics and Intelligent Machines, Georgia Institute of Technology（佐治亚理工学院机器人与智能机器研究所）
Search-and-rescue (SaR) in unknown environments requires precise, optimal, and fast decisions. Robots are promising candidates for autonomously performing SaR tasks in unknown environments. While humans use their heuristics to effectively deal with uncertainties, optimisation of multiple objectives in the presence of physical and control constraints is a mathematical challenge that requires machine computations. Thus having both human-inspired and mathematical control capabilities is desired for SaR robots. Moreover, coordinating the decisions of robots with little computation cost in large-sc…
National University of Defense Technology（国防科技大学）；Jilin University（吉林大学）
Robust model predictive control (MPC) is a well-known control technique for model-based control with constraints and uncertainties. In classic robust tube-based MPC approaches, an open-loop control sequence is computed via periodically solving an online nominal MPC problem, which requires prior model information and frequent access to onboard computational resources. In this paper, we propose an efficient robust MPC solution based on receding horizon reinforcement learning, called r-LPC, for unknown nonlinear systems with state constraints and disturbances. The proposed r-LPC utilizes a Koopma…
We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems commonly model the nonlinear effects of an unknown environment on a nominal system. We optimize over a class of nonlinear feedback policies inspired by certainty equivalent "estimate-and-cancel" control laws pioneered in classical adaptive control to achieve significant performance improvements in the presence of uncertainties of large magnitude, a setting in…
