Several studies have reported the importance of optimally operating the absorption column in a post-combustion CO2 capture (PCC) plant. It has been demonstrated in our previous work how economic Model Predictive Control (EMPC) has a great potential to improve the operation of the PCC plant. However, the use of a general economic objective such as maximizing the absorption efficiency of the column can cause EMPC to drive the state of the system close to the constraints. This may often than not lead to solvent overcirculation and flooding which are undesirable. In this work, we present an EMPC with zone tracking algorithm as an effective means to address this problem. The proposed control algorithm incorporates a zone tracking objective and an economic objective to form a multi-objective optimal control problem. To ensure that the zone tracking objective is achieved in the presence of model uncertainties and time-varying flue gas flow rate, we propose a method to modify the original target zone with a control invariant set. The zone modification method combines both ellipsoidal control invariant set techniques and a back-off strategy. The use of ellipsoidal control invariant sets ensure that the method is applicable to large scale systems such as the absorption column. We present several simulation case studies that demonstrate the effectiveness and applicability of the proposed control algorithm to the absorption column in a post-combustion CO2 capture plant.
In this paper, we investigate system theoretic properties of transient average constrained economic model predictive control (MPC) without terminal constraints. We show that the optimal open-loop solution passes by the optimal steady-state for consecutive time instants. Using this turnpike property and suitable controllability conditions, we provide closed-loop performance bounds. Furthermore, stability is proved by combining the rotated value function with an input-to-state (ISS) Lyapunov function of an extended state related to the transient average constraints. The results are illustrated w…
Economic Model Predictive Control (MPC) dissipativity theory is central to discussing the stability of policies resulting from minimizing economic stage costs. In its current form, the dissipativity theory for economic MPC applies to problems based on deterministic dynamics or to very specific classes of stochastic problems, and does not readily extend to generic Markov Decision Processes. In this paper, we clarify the core reason for this difficulty, and propose a generalization of the economic MPC dissipativity theory that circumvents it. This generalization focuses on undiscounted infinite-…
In this paper, we propose a data-driven economic model predictive control (EMPC) scheme with generalized terminal constraint to control an unknown linear time-invariant system. Our scheme is based on the Fundamental Lemma to predict future system trajectories using a persistently exciting input-output trajectory. The control objective is to minimize an economic cost objective. By employing a generalized terminal constraint with artificial equilibrium, the scheme does not require prior knowledge of the optimal equilibrium. We prove that the asymptotic average performance of the closed-loop syst…
Energy efficiency and safety are two critical objectives for marine vehicles operating in environments with obstacles, and they generally conflict with each other. In this paper, we propose a novel online motion planning method of marine vehicles which can make trade-offs between the two design objectives based on the framework of economic model predictive control (EMPC). Firstly, the feasible trajectory with the most safety margin is designed and utilized as tracking reference. Secondly, the EMPC-based receding horizon motion planning algorithm is designed, in which the practical consumed ene…
This paper discusses the functional stability of closed-loop Markov Chains under optimal policies resulting from a discounted optimality criterion, forming Markov Decision Processes (MDPs). We investigate the stability of MDPs in the sense of probability measures (densities) underlying the state distributions and extend the dissipativity theory of Economic Model Predictive Control in order to characterize the MDP stability. This theory requires a so-called storage function satisfying a dissipativity inequality. In the probability measures space and for the discounted setting, we introduce new …
In this paper, we provide non-averaged and transient performance guarantees for recently developed, tube-based robust economic model predictive control (MPC) schemes. In particular, we consider both tube-based MPC schemes with and without terminal conditions. We show that the closed-loop performance obtained by applying such MPC schemes is approximately optimal when evaluated both on finite and infinite time horizons. These performance bounds are similar to those derived previously for nominal economic MPC. The theoretical results are discussed in a numerical example.
Economic Model Predictive Control has recently gained popularity due to its ability to directly optimize a given performance criterion, while enforcing constraint satisfaction for nonlinear systems. Recent research has developed both numerical algorithms and stability analysis for the undiscounted case. The introduction of a discount factor in the cost, however, can be desirable in some cases of interest, e.g., economics, stochastically terminating processes, Markov decision processes, etc. Unfortunately, the stability theory in this case is still not fully developed. In this paper we propose …
Deep Neural Koopman Operator-based Economic Model Predictive Control of Shipboard Carbon Capture System
Nanyang Technological University（南洋理工大学）；School of Chemistry, Chemical Engineering and Biotechnology（化学、化学工程与生物技术学院）；Nanyang Environment & Water Research Institute (NEWRI)（南洋环境与水研究所）
Norwegian University of Science and Technology (NTNU)（挪威科技大学）
In this paper, we are interested in optimal control problems with purely economic costs, which often yield optimal policies having a (nearly) bang-bang structure. We focus on policy approximations based on Model Predictive Control (MPC) and the use of the deterministic policy gradient method to optimize the MPC closed-loop performance in the presence of unmodelled stochasticity or model error. When the policy has a (nearly) bang-bang structure, we observe that the policy gradient method can struggle to produce meaningful steps in the policy parameters. To tackle this issue, we propose a homoto…
This chapter compares different formulations for Economic nonlinear Model Predictive Control (EMPC) which are all based on an established dissipativity assumption on the underlying Optimal Control Problem (OCP). This includes schemes with and without stabilizing terminal constraints, respectively, or with stabilizing terminal costs. We recall that a recently proposed approach based on gradient correcting terminal penalties implies a terminal constraint on the adjoints of the OCP. We analyze the feasibility implications of these dual/adjoint terminal constraints and we compare our findings to a…
In the Economic Nonlinear Model Predictive (ENMPC) context, closed-loop stability relates to the existence of a storage function satisfying a dissipation inequality. Finding the storage function is in general -- for nonlinear dynamics and cost -- challenging, and has attracted attentions recently. Q-Learning is a well-known Reinforcement Learning (RL) techniques that attempts to capture action-value functions based on the state-input transitions and stage cost of the system. In this paper, we present the use of the Q-Learning approach to obtain the storage function and verify the dissipativity…
Economic model predictive control (EMPC) has attracted significant attention in recent years and is recognized as a promising advanced process control method for the next generation smart manufacturing. It can lead to improving economic performance but at the same time increases the computational complexity significantly. Model approximation has been a standard approach for reducing computational complexity in process control. In this work, we perform a study on three types of representative model approximation methods applied to EMPC, including model reduction based on available first-princip…
Improving greenhouse fruit-production control by integrating reinforcement learning into short-horizon model predictive control
Wageningen University & Research（瓦赫宁根大学与研究）；Delft Center for Systems and Control (DCSC), Delft University of Technology（代尔夫特理工大学系统与控制中心）；Wageningen Research（瓦赫宁根研究）
Nonlinear Model Predictive Control of A Gasoline HCCI Engine Using Extreme Learning Machines
NASA Ames Research Center（美国国家航空航天局艾姆斯研究中心）；Department of Mechanical Engineering, University of Michigan（密歇根大学机械工程系）；Department of Statistics, University of Michigan（密歇根大学统计系）；Stony Brook University（石溪大学）
In this paper, a novel tube-based economic Model Predictive Control (MPC) scheme for uncertain systems that uses neither terminal costs nor terminal constraints is investigated. We show that the results from the undisturbed case can be extended to systems with bounded disturbances by using similar turnpike arguments and a properly modified stage cost. We prove robust guarantees on the closed-loop performance, convergence, and stability under suitable dissipativity and controllability conditions and discuss them in a numerical example.
In this paper, we consider the problem of periodic optimal control of nonlinear systems subject to online changing and periodically time-varying economic performance measures using model predictive control (MPC). The proposed economic MPC scheme uses an online optimized artificial periodic orbit to ensure recursive feasibility and constraint satisfaction despite unpredictable changes in the economic performance index. We demonstrate that the direct extension of existing methods to periodic orbits does not necessarily yield the desirable closed-loop economic performance. Instead, we carefully r…
In this paper, we present the use of Reinforcement Learning (RL) based on Robust Model Predictive Control (RMPC) for the control of an Autonomous Surface Vehicle (ASV). The RL-MPC strategy is utilized for obstacle avoidance and target (set-point) tracking. A scenario-tree robust MPC is used to handle potential failures of the ship thrusters. Besides, the wind and ocean current are considered as unknown stochastic disturbances in the real system, which are handled via constraints tightening. The tightening and other cost parameters are adjusted by RL, using a Q-learning technique. An economic c…
