Adaptive set-point regulation of discrete-time nonlinear systems
Shigeru Hanba
备注：
This work was supported by the Japan Society for the Promotion of Science under Grant-in-Aid for Scientific Research (C) 23560535. This manuscript is a former version of the manuscript the author has submitted to International Journal of Adaptive Control and Signal Processing
In this paper, adaptive set-point regulation controllers for discrete-time nonlinear systems are constructed. The system to be controlled is assumed to have a parametric uncertainty, and an excitation signal is used in order to obtain the parameter estimate. The proposed controller belongs to the category of indirect adaptive controllers, and its construction is based on the policy of calculating the control input rather than that of obtaining a control law. The proposed method solves the adaptive set-point regulation problem under the (possibly minimal) assumption that the target state is reachable provided that the parameter is known. Additional feature of the proposed method is that Lyapunov-like functions have not been used in the construction of the controllers.
In this paper, we first present an adaptive distributed observer for a discrete-time leader system. This adaptive distributed observer will provide, to each follower, not only the estimation of the leader's signal, but also the estimation of the leader's system matrix. Then, based on the estimation of the matrix S, we devise a discrete adaptive algorithm to calculate the solution to the regulator equations associated with each follower, and obtain an estimated feedforward control gain. Finally, we solve the cooperative output regulation problem for discrete-time linear multi-agent systems by b…
In this paper, we study the cooperative robust output regulation problem for discrete-time linear multi-agent systems with both communication and input delays by distributed internal model approach. We first introduce the distributed internal model for discrete-time multi-agent systems with both communication and input delays. Then, we define so-called auxiliary system and auxiliary augmented system. Finally, we solve our problem by showing, under some standard assumptions, that if a distributed state feedback control or a distributed output feedback control solves the robust output regulation…
This paper considers the cooperative output regulation problem for linear multi-agent systems with a directed communication graph, heterogeneous linear subsystems, and an exosystem whose output is available to only a subset of subsystems. Both the cases with nominal and uncertain linear subsystems are studied. For the case with nominal linear subsystems, a distributed adaptive observer-based controller is designed, where the distributed adaptive observer is implemented for the subsystems to estimate the exogenous signal. For the case with uncertain linear subsystems, the proposed distributed o…
In this paper, we study the cooperative output regulation problem for the discrete linear time-delay multi-agent systems by distributed observer approach. In contrast with the same problem for continuous-time linear time-delay multi-agent systems, the problem has two new features. First, in the presence of time-delay, the regulator equations for discrete-time linear systems are different from those for continuous-time linear systems. Second, under the standard assumption on the connectivity of the communication graph, a distributed observer for any continuous-time linear leader system always e…
This paper shows how the theory of adaptive observers can be effectively used in the design internal models for nonlinear output regulation. The main result obtained in this way is a new method for the synthesis of adaptive internal models which substantially enhances the existing theory of adaptive output regulation, by allowing nonlinear internal models and more general classes of controlled plants.
The voltage received by each customer connected to a power distribution line with local controllers (inverters) is regulated to be within a desired margin through a class of slope-restricted controllers, known conventionally as \emph{droop} controllers. We adapt the design of the droop controllers according to the known bounds of the net power consumption of each customer in each observation time window. A sufficient condition for voltage regulation is provided for each time window, which guides the design of the droop controllers, depending on the properties of the distribution line (line imp…
This paper considers power distribution networks with distributed energy resources and designs an incentive-based algorithm that allows the network operator and customers to pursue given operational and economic objectives while concurrently ensuring that voltages are within prescribed limits. Heterogeneous DERs with continuous and discrete control commands are considered. We address four major challenges: discrete decision variables, non-convexity due to a Stackelberg game structure, unavailability of private information from customers, and asynchronous operation. Starting from a non-convex s…
A new framework for adaptive regulation to invariant sets is proposed. Reaching the target dynamics (invariant set) is to be ensured by state feedback while adaptation to parametric uncertainties is provided by additional adaptation algorithm. We show that for a sufficiently large class of nonlinear systems it is possible to adaptively steer the system trajectories to the desired non-equilibrium state without requiring knowledge or existence of a specific strict Lyapunov function.
In this paper, we consider a discrete-time stochastic control problem with uncertain initial and target states. We first discuss the connection between optimal transport and stochastic control problems of this form. Next, we formulate a linear-quadratic regulator problem where the initial and terminal states are distributed according to specified probability densities. A closed-form solution for the optimal transport map in the case of linear-time varying systems is derived, along with an algorithm for computing the optimal map. Two numerical examples pertaining to swarm deployment demonstrate…
Stochastic Optimal Linear Quadratic Regulation Control of Discrete-time Systems with Delay and Quadratic Constraints
School of Control Science and Engineering, Shandong University（山东大学控制科学与工程学院）；College of Electrical Engineering and Automation, Shandong University of Science and Technology（山东科技大学电气工程学院）
This paper shows how the theory of nonlinear adaptive observers can be effectively used in the design of internal models for nonlinear output regulation. The theory substantially enhances the existing results in the context of {\em adaptive} output regulation, by allowing for not necessarily stable zero dynamics of the controlled plant and by weakening the standard assumption of having the steady state control input generated by a linear system.
An adaptive funnel control method is considered for the regulation of the output for a class of nonlinear infinite-dimensional systems on real Hilbert spaces. After a decomposition of the state space and some change of variables related to the Byrnes-Isidori form, it is shown that the funnel controller presented in (Berger et al., 2020) achieves the control objective under some assumptions on the nonlinear system dynamics, like well-posedness and Bounded-Input-State Bounded-Output (BISBO) stability. The theory is applied to the regulation of the temperature in a chemical plug-flow tubular reac…
We consider controller design for robust output tracking and disturbance rejection for continuous-time periodic linear systems with periodic reference and disturbance signals. As our main results we present four different controllers: A feedforward control law and a discrete-time dynamic error feedback controller for output tracking and disturbance rejection, a robust discrete-time feedback controller, and finally a discrete-time feedback controller that achieves approximate robust output tracking and disturbance rejection. The presented constructions are also new for time-invariant finite and…
In the absence of persistency of excitation (PE), referring to adaptive control systems as "asymptotically stable" typically indicates insufficient understanding of stability concepts. While the state is indeed regulated to zero and the parameter estimate has some limit, namely, the overall state converges to some equilibrium, the equilibrium reached is not unique (and not even necessarily stable) but is dependent on the initial condition. The equilibrium set in the absence of PE is not uniformly attractive (from an open set containing the equilibrium set); hence, asymptotic stability does not…
Initial hopes of quickly eradicating the COVID-19 pandemic proved futile, and the goal shifted to controlling the peak of the infection, so as to minimize the load on healthcare systems. To that end, public health authorities intervened aggressively to institute social distancing, lock-down policies, and other Non-Pharmaceutical Interventions (NPIs). Given the high social, educational, psychological, and economic costs of NPIs, authorities tune them, alternatively tightening up or relaxing rules, with the result that, in effect, a relatively flat infection rate results. For example, during the…
In this paper we consider a class of conjugate discrete-time Riccati equations, arising originally from the linear quadratic regulation problem for discrete-time antilinear systems. Under mild and reasonable assumptions, the existence of the maximal solution to the conjugate discrete-time Riccati equation, in which the control weighting matrix is nonsingular and its constant term is Hermitian, will be inherited to a transformed discrete-time algebraic Riccati equation. Based on this inheritance property, an accelerated fixed-point iteration is proposed for finding the maximal solution via the …
We discuss a design approach for nonlinear discrete-time adaptive observer. This involves transforming a nonlinear system into a quasi-LPV (Linear Parameter Varying) polytopic model in Takagi-Sugeno (T-S) form using nonlinear embedding and sector nonlinearity (SNL) transformation. We then develop a discrete-time counterpart for a joint state and parameter estimation, based on design strategies developed for continuous time models in the existing literature. The design uses a Lyapunov approach and provides an error bounded by $\mathbb{L}_2$ gain. Based on this strategy, we propose a design for …
This paper presents a performance-regulation method for a class of stochastic timed event-driven systems aimed at output tracking of a given reference setpoint. The systems are either Discrete Event Dynamic Systems (DEDS) such as queueing networks or Petri nets, or Hybrid Systems (HS) with time-driven dynamics and event-driven dynamics, like fluid queues and hybrid Petri nets. The regulator, designed for simplicity and speed of computation, is comprised of a single integrator having a variable gain to ensure effective tracking under time-varying plants. The gain's computation is based on the I…
This paper is motivated by the problem of quantitatively bounding the convergence of adaptive control methods for stochastic systems to a stationary distribution. Such bounds are useful for analyzing statistics of trajectories and determining appropriate step sizes for simulations. To this end, we extend a methodology from (unconstrained) stochastic differential equations (SDEs) which provides contractions in a specially chosen Wasserstein distance. This theory focuses on unconstrained SDEs with fairly restrictive assumptions on the drift terms. Typical adaptive control schemes place constrain…
Robust implementable output regulator design approaches are studied for general linear continuous-time \mbox{systems} with periodically sampled measurements, consisting of both the regulation errors and extra measurements that are generally non-vanishing in steady state. A digital regulator is first developed via the conventional emulation-based approach, rendering the regulation errors asymptotically bounded with a small sampling period. We then develop a hybrid design framework by incorporating a generalized hold device, which transforms the original problem into the problem of designing an …
This paper considers a real-time electricity market involving an independent system operator (ISO) and a group of strategic generators. The ISO operates a market where generators bid prices at which there are willing to provide power. The ISO makes power generation assignments with the goal of solving the economic dispatch problem and regulating the network frequency. We propose a multi-rate hybrid algorithm for bidding and market clearing that combines the discrete nature of iterative bidding with the continuous nature of the frequency evolution in the power network. We establish sufficient u…
Optimal Output Feedback Learning Control for Discrete-Time Linear Quadratic Regulation
School of Automation, Beijing Institute of Technology, Beijing 100081, China（自动化学院，北京理工大学，北京）；Department of Chemical Engineering, Queen’s University, Kingston, ON K7L 3N6, Canada（化学工程系，皇后大学，加拿大）
A new technique for performance regulation in event-driven systems, recently proposed by the authors, consists of an adaptive-gain integral control. The gain is adjusted in the control loop by a real-time estimation of the derivative of the plant-function with respect to the control input. This estimation is carried out by Infinitesimal Perturbation Analysis (IPA). The main motivation comes from applications to throughput regulation in computer processors, where to-date, testing and assessment of the proposed control technique has been assessed by simulation. The purpose of this paper is to re…
The paper deals with the problem of output regulation in a "non-equilibrium" context for a special class of multivariable nonlinear systems stabilizable by high-gain feedback. A post-processing internal model design suitable for the multivariable nature of the system, which might have more inputs than regulation errors, is proposed. Uncertainties in the system and exosystem are dealt with by assuming that the ideal steady state input belongs to a certain "class of signals" by which an appropriate model set for the internal model can be derived. The adaptation mechanism for the internal model i…
In this paper we extend the adaptive gradient descent (AdaGrad) algorithm to the optimal distributed control of parabolic partial differential equations with uncertain parameters. This stochastic optimization method achieves an improved convergence rate through adaptive scaling of the gradient step size. We prove the convergence of the algorithm for this infinite dimensional problem under suitable regularity, convexity, and finite variance conditions, and relate these to verifiable properties of the underlying system parameters. Finally, we apply our algorithm to the optimal thermal regulation…
Nonadaptive Output Regulation of Second-Order Nonlinear Uncertain Systems
School of Automation, Beijing Institute of Technology（自动化学院，北京理工大学）；Beijing Institute of Technology Chongqing Innovation Center（北京理工大学重庆创新中心）；Department of Chemical Engineering, Queen’s University（化学工程系，皇后大学）；Massachusetts Institute of Technology（麻省理工学院）
This paper concerns the adaptive control of a class of discrete-time nonlinear systems with all states accessible. Recently, a high-order tuner algorithm was developed for the minimization of convex loss functions with time-varying regressors in the context of an identification problem. Based on Nesterov's algorithm, the high-order tuner was shown to guarantee bounded parameter estimation when regressors vary with time, and to lead to accelerated convergence of the tracking error when regressors are constant. In this paper, we apply the high-order tuner to the adaptive control of a particular …
