This paper considers a co-design problem for industrial networked control systems to ensure both the stability and efficiency properties of such systems. The assurance of such properties is particularly challenging due to the fact that wireless communications in industrial environments are not only subject to shadow fading but also stochastically correlated with their surrounding environments. To address such challenges, this paper first introduces a novel state-dependent Markov channel (SD-MC) model that explicitly captures the state-dependent features of industrial wireless communication systems by defining the proposed model's transition probabilities as a function of both its environment's states and transmission power. Under the proposed channel model, sufficient conditions on Maximum Allowable Transmission Interval (MATI) are presented to ensure both asymptotic stability in expectation and almost sure asymptotic stability properties of a continuous nonlinear control system with state-dependent fading channels. Based on such conditions, the co-design problem is then formulated as a constrained polynomial optimization problem (CPOP), which can be efficiently solved using semidefinite programming methods for the case of a two-state state dependent Markovian channel. The solutions to such a CPOP represent optimal control and power strategies that optimize the average expected joint costs in an infinite time horizon while still respect the stability constraints. For a general SD-MC model, this paper further shows that sub-optimal solutions can be obtained from linear programming formulations of the considered CPOP. Simulation results are given to illustrate the efficacy of the proposed co-design scheme.
This manuscript discusses a scalable controller synthesis method for networked systems with a large number of identical subsystems based on the H-infinity control framework. The dynamics of the individual subsystems are described by identical linear time-invariant delay differential equations and the effect of transport and communication delay is explicitly taken into account. The presented method is based on the result that, under a particular assumption on the graph describing the interconnections between the subsystems, the H-infinity norm of the overall system is upper bounded by the robus…
We consider the problem of designing distributed controllers to stabilize a class of networked systems, where each subsystem is dissipative and designs a reinforcement learning based local controller to maximize an individual cumulative reward function. We develop an approach that enforces dissipativity conditions on these local controllers at each subsystem to guarantee stability of the entire networked system. The proposed approach is illustrated on a DC microgrid example, where the objective is maintain voltage stability of the network using local distributed controllers at each generation …
This paper studies the distributed L2-gain control problem for continuous-time large-scale systems under Round-Robin communication protocol. In this protocol, each sub-controller obtains its own subsystem's state information continuously, while communicating with neighbors at discrete-time instants periodically. Distributed controllers are designed such that the closed-loop system is exponentially stable and that the prescribed L2-gain is satisfied. The design condition is obtained based on a time-delay approach and given in terms of linear matrix inequalities. Finally, three numerical example…
Design of a Networked Controller for a Two-Wheeled Inverted Pendulum Robot
Technische Universität Berlin(柏林工业大学);Technische Universität München(慕尼黑工业大学);Max-Planck-Institut für Dynamik komplexer technischer Systeme(复杂技术系统动力学马普研究所)
An optimal control law for networked control systems with a discrete-time linear time-invariant (LTI) system as plant and networks between sensor and controller as well as between controller and actuator is proposed. This controller is designed by solving an optimization problem that is a generalization of the optimization problem used to obtain the Linear Quadratic Regulator (LQR) for deterministic discrete-time LTI systems. The networks are represented by random delays and drop outs of transmitted data packets.
This paper studies stochastic aperiodic stabilization of a networked control system (NCS) consisting of a continuous-time plant and a discrete-time controller. The plant and the controller are assumed to be connected by communication channels with i.i.d. time-varying delays. The delays are theoretically not required to be bounded even when the plant is unstable in the deterministic sense. In our NCS, the sampling interval is supposed to be determined directly by such communication delays. A necessary and sufficient inequality condition is presented for designing a state-feedback controller sta…
The paper considers continuous-time networked susceptible-infected-susceptible (SIS) diseases spreading over a population. Each agent represents a sub-population and has its own healing rate and infection rate; the state of the agent at a time instant denotes what fraction of the said sub-population is infected with the disease at the said time instant. By taking account of the changes in behaviors of the agents in response to the infection rates in real-time, our goal is to devise a feedback strategy such that the infection level for each agent strictly stays below a pre-specified value. Furt…
The communication channels used to convey information between the components of wireless networked control systems (WNCSs) are subject to packet losses due to time-varying fading and interference. We consider a wireless networked control scenario, where the packet loss occurs in both the sensor-controller link (sensing link) and the controller-actuator link (actuation link). Moreover, we consider one time-step delay mode observations of the actuation link. While the problems of state feedback optimal control and stabilizability conditions for systems with one time-step delay mode observations …
Separated design of encoder and controller for networked linear quadratic optimal control
School of Computing and Electrical Engineering, Indian Institute of Technology, Mandi, India(印度曼迪印度理工学院计算与电气工程学院);School of Electrical Engineering, Royal Institute of Technology, Stockholm, Sweden(瑞典斯德哥尔摩皇家理工学院电气工程学院)
We consider the joint design of control and scheduling under stochastic Denial-of-Service (DoS) attacks in the context of networked control systems. A sensor takes measurements of the system output and forwards its dynamic state estimates to a remote controller over a packet-dropping link. The controller determines the optimal control law for the process using the estimates it receives. An attacker aims at degrading the control performance by increasing the packet-dropout rate with a DoS attack towards the sensor-controller channel. We assume both the controller and the attacker are rational i…
We propose a unified framework to fast generate a safe optimal control action for a new task from existing controllers on Multi-Agent Systems (MASs). The control action composition is achieved by taking a weighted mixture of the existing controllers according to the contribution of each component task. Instead of sophisticatedly tuning the cost parameters and other hyper-parameters for safe and reliable behavior in the optimal control framework, the safety of each single task solution is guaranteed using the control barrier functions (CBFs) for high-degree stochastic systems, which constrains …
In this paper, we propose a design of a model-free networked controller for a nonlinear plant whose mathematical model is unknown. In a networked control system, the controller and plant are located away from each other and exchange data over a network, which causes network delays that may fluctuate randomly due to network routing. So, in this paper, we assume that the current network delay is not known but the maximum value of fluctuating network delays is known beforehand. Moreover, we also assume that the sensor cannot observe all state variables of the plant. Under these assumption, we app…
In the present work, an embedded PI controller is designed for speed regulation of DC servomotor over a wireless network. The embedded controller integrates PI controller with a proposed time-delay estimator and an adaptive digital Smith predictor for its real time operation, which is the novelty of the work. The real time or rather online operation of the developed embedded controller over wireless network is possible mainly due to the contributions in terms of proposing a new empirical formula for time-delay estimation, viable approximation of time-delay, discretization scheme in developing …
We introduce a versatile framework to model and study networked control systems (NCSs). An NCS is described as a feedback interconnection of a plant and a controller communicating through a bidirectional channel modelled by cascaded nonlinear two-port networks. This model is sufficiently rich to capture various properties of a real-world communication channel, such as distortion, interference, and nonlinearity. Uncertainties in the plant, controller and communication channels can be handled simultaneously in the framework. We provide a necessary and sufficient condition for the robust finite-g…
We analyze a cost-minimization problem in which the controller relies on an imperfect timeseries forecast. Forecasting models generate imperfect forecasts because they use anonymization noise to protect input data privacy. However, this noise increases the control cost. We consider a scenario where the controller pays forecasting models incentives to reduce the noise and combines the forecasts into one. The controller then uses the forecast to make control decisions. Thus, forecasting models face a trade-off between accepting incentives and protecting privacy. We propose an approach to allocat…
Near-Optimal Distributed Linear-Quadratic Regulator for Networked Systems
Mathematics and Computer Science Division, Argonne National Laboratory(阿贡国家实验室数学与计算机科学部);California Institute of Technology(加州理工学院);Department of Electrical and Computer Engineering, Carnegie Mellon University(卡内基梅隆大学电气与计算机工程系);Department of Statistics, University of Chicago(芝加哥大学统计系)
In this work, we propose a compositional scheme for the safety controller synthesis of interconnected discrete-time stochastic systems with Markovian switching signals. Our proposed approach is based on a notion of so-called control storage certificates computed for individual subsystems, by leveraging which, one can synthesize state-feedback controllers for interconnected systems to enforce safety specifications over finite time horizons. To do so, we employ a sum-of-squares (SOS) optimization approach to search for multiple storage certificates of each switching subsystem while synthesizing …
Graph Neural Network-Based Distributed Optimal Control for Linear Networked Systems: An Online Distributed Training Approach
Department of Electrical Engineering, University of Notre Dame(电气工程系,诺丁汉大学);Department of Electrical and Computer Engineering, Stevens Institute of Technology(电气与计算机工程系,史蒂文斯理工学院)
We investigate the problem of stabilizing an unknown networked linear system under communication constraints and adversarial disturbances. We propose the first provably stabilizing algorithm for the problem. The algorithm uses a distributed version of nested convex body chasing to maintain a consistent estimate of the network dynamics and applies system level synthesis to determine a distributed controller based on this estimated model. Our approach avoids the need for system identification and accommodates a broad class of communication delay while being fully distributed and scaling favorabl…
Passivity based distributed tracking control of networked Euler-Lagrange systems
Jan C. Willems Center for Systems and Control, Faculty of Science and Engineering, University of Groningen(格罗宁根大学科学与工程学部扬C威尔姆斯系统与控制中心);Faculty of Science and Engineering, University of Groningen(格罗宁根大学科学与工程学部)
A Passivity-Based Design for Stability and Robustness in Event-Triggered Networked Control Systems with Communication Delays, Signal Quantizations and Packet Dropouts
This paper addresses finite-time horizon optimal control of single-loop networked control systems with stochastically modeled communication channel and disturbances. To cope with the uncertainties, an optimization-based control scheme is proposed which uses a disturbance feedback and the age of information as central aspects. The disturbance feedback is an extension of the control law used for balanced stochastic optimal control previously proposed for control systems without network. Balanced optimality is understood as a compromise between minimizing of expected deviations from the reference…
This paper considers the fixed-time control problem of a multi-agent system composed of a class of Euler-Lagrange dynamics with parametric uncertainty and a dynamic leader under a directed communication network. A distributed fixed-time observer is first proposed to estimate the desired trajectory and then a fixed-time controller is constructed by transforming uncertain Euler-Lagrange systems into second-order systems and utilizing the backstepping design procedure. The overall design guarantees that the synchronization errors converge to zero in a prescribed time independent of initial condit…