In this paper, we study the trade-off between the transmission cost and the control performance of the multi-loop networked control system subject to network-induced delay. Within the linear-quadratic-Gaussian (LQG) framework, the joint design of control policy and networking strategy is decomposed into separation optimization problems. Based on the trade-off analysis, a scalable, delay-dependent Value-of-Information (VoI) based scheduling policy is constructed to quantify the value of transmitting the data packet, and enables the decision-makers embedded in subsystems to determine the transmission policy. The proposed scalable VoI inherits the task criticality of the previous VoI metric meanwhile is sensitive to the system parameters such as information freshness and network delays. The VoI-based scheduling policy is proved to outperform the periodical triggering policy and existing Age-of-Information (AoI) based policy for network control system under transmission delay. The effectiveness of the constructed VoI with arbitrary network delay is validated through numerical simulations.
In this work, we study the problem of supervisory control of networked discrete event systems. We consider lossy communication channels with bounded network delays, for both the control channel and the observation channel. By a model transformation, we transform the networked supervisor synthesis problem into the classical (non-networked) supervisor synthesis problem (for non-deterministic plants), such that the existing supervisor synthesis tools can be used for synthesizing networked supervisors. In particular, we can use the (state-based) normality property for the synthesis of the supremal…
This paper studies stochastic aperiodic stabilization of a networked control system (NCS) consisting of a continuous-time plant and a discrete-time controller. The plant and the controller are assumed to be connected by communication channels with i.i.d. time-varying delays. The delays are theoretically not required to be bounded even when the plant is unstable in the deterministic sense. In our NCS, the sampling interval is supposed to be determined directly by such communication delays. A necessary and sufficient inequality condition is presented for designing a state-feedback controller sta…
Conventional supervisory control theory assumes full synchronization between the supervisor and the plant. This assumption is violated in a networked-based communication setting due to the presence of delays, and this may result in incorrect behavior of a supervisor obtained from conventional supervisory control theory. This paper presents a technique to synthesize a networked supervisor handling communication delays. For this purpose, first, a networked supervisory control framework is provided, where the supervisor interacts with the plant through control and observation channels, both of wh…
A networked output feedback loop subject to packetized transmissions of the output signal is considered. Based on the small gain theorem, an easy-to-use stability criterion covering two important cases is presented. In the first case a packet numbering mechanism is employed whereas in the second case neither packet numbering nor synchronization between sender and receiver is assumed. The analysis makes use of acausal subsystems and deduces the optimal constant time delay that should be used in a nominal controller design such that additional packet delay variations introduced by the network ar…
This paper presents an overview of the networked supervisory control framework for discrete event systems with imperfect communication networks, which can be divided into the centralized supervisory control setup and the decentralized supervisory control setup. We review the state-of-art networked control frameworks with observation channel delays and control channel delays, for untimed and timed models. Data losses in communication channels are also considered. The review of the state-of-art networked control frameworks will be focused on the following parts: 1) the construction of the networ…
This letter deals with the problem of quantifying resiliency of Networked Control Systems (NCSs) to Denial-of-Service (DoS) attacks and variable network delays. Internal exponential stability and $\mathcal{L}_2$ external stability are studied. The closed-loop system is augmented with an auxiliary timer variable and analyzed in a hybrid system framework. Lyapunov-like conditions are given to ensure $0$-input global exponential stability and $\mathcal{L}_2$ external stability. A computationally affordable algorithm based on linear matrix inequalities is devised to provide trade-off curves betwee…
This work mainly investigates the mean-square stability and stabilizability for a single-input single-output networked linear feedback system. The control signal in the networked system is transmitted over an unreliable channel. In this unreliable channel, the data transmission times, referred to as channel induced delays, are random values and the transmitted data could also be dropout with certain probability. The channel induced delays and packet dropout are modeled by an independent and identically distributed stochastic process with a fixed probability mass function. At the channel termin…
This work studies the mean-square stability and stabilization problem for networked feedback systems. Data transmission delays in the network channels of the systems are considered. It is assumed that these delays are i.i.d. processes with given probability mass functions (PMFs). A necessary and sufficient condition of mean-square (input-output) stability is studied for the networked feedback systems in terms of the input-output model and state-space model. Furthermore, according to this condition, mean-square stabilization via output feedback is studied for the networked feedback systems.
Filtered Smith predictors are well established for controlling linear plants with constant time delays. Apart from this classical application scenario, they are also employed within networked control loops, where the measurements are sent in separate packets over a transmission channel that is subject to time-varying delays. However, no stability guarantees can be given in this case. The present paper illustrates that the time-varying delays as well as the packetized character of the transmissions have to be taken into account for stability analysis. Hence, three network protocols, which use d…
This paper studies the tracking control problem of nonlinear networked and quantized control systems (NQCSs) with communication delays. The desired trajectory is generated by a reference system. The communication network is to guarantee the information transmission among the plant, the reference system and the controller. The communication network also brings about some undesired issues like time-varying transmission intervals, time-varying transmission delays, packet dropouts, scheduling and quantization effects, which lead to non-vanishing network-induced errors and affect the tracking perfo…
We apply deep reinforcement learning (DRL) to design of a networked controller with network delays to complete a temporal control task that is described by a signal temporal logic (STL) formula. STL is useful to deal with a specification with a bounded time interval for a dynamical system. In general, an agent needs not only the current system state but also the past behavior of the system to determine a desired control action for satisfying the given STL formula. Additionally, we need to consider the effect of network delays for data transmissions. Thus, we propose an extended Markov decision…
In the context of networked discrete-event systems (DESs), communication delays and losses exist between the plant and the supervisor for observation and between the supervisor and the actuator for control. In this paper, we first introduce a new framework for supervisory control of networked DESs. Under the introduced framework, we address the state estimation problem for supervisor synthesis of networked DESs with both communication delays and losses. The estimation algorithm considers the effect of the controls imposed on the system. Additionally, the estimation algorithm is based on the co…
Networked Constrained Cyber-Physical Systems subject to malicious attacks: a resilient set-theoretic control approach
DIMES, Universitá degli Studi della Calabria（卡拉布里亚大学 DIMES）；Electrical and Computer Engineering Department, Carnegie Mellon University（卡内基梅隆大学电气与计算机工程学院）
In decentralized networked supervisory control of discrete-event systems (DESs), the local supervisors observe event occurrences subject to observation delays to make correct control decisions. Delay coobservability describes whether these local supervisors can make sufficient observations. In this paper, we provide an efficient way to verify delay coobservability. For each controllable event, we partition the specification language into a finite number of sets such that strings in different sets have different lengths. For each of the sets, we construct a verifier to check if delay coobservab…
In the present work, an embedded PI controller is designed for speed regulation of DC servomotor over a wireless network. The embedded controller integrates PI controller with a proposed time-delay estimator and an adaptive digital Smith predictor for its real time operation, which is the novelty of the work. The real time or rather online operation of the developed embedded controller over wireless network is possible mainly due to the contributions in terms of proposing a new empirical formula for time-delay estimation, viable approximation of time-delay, discretization scheme in developing …
Design of a Networked Controller for a Two-Wheeled Inverted Pendulum Robot
Technische Universität Berlin（柏林工业大学）；Technische Universität München（慕尼黑工业大学）；Max-Planck-Institut für Dynamik komplexer technischer Systeme（复杂技术系统动力学马普研究所）
An analytical framework for analysis and design of networked control systems with random delays and packet losses
National Institute of Technology- Calicut（卡利卡特国家理工学院）；ABB India Corporate Research Center（ABB印度企业研究中心）；National Institute of Technology-Tiruchirappalli（蒂鲁奇拉帕利国家理工学院）
In the operation of networked control systems, where multiple processes share a resource-limited and time-varying cost-sensitive network, communication delay is inevitable and primarily influenced by, first, the control systems deploying intermittent sensor sampling to reduce the communication cost by restricting non-urgent transmissions, and second, the network performing resource management to minimize excessive traffic and eventually data loss. In a heterogeneous scenario, where control systems may tolerate only specific levels of sensor-to-controller latency, delay sensitivities need to be…
We propose a distributed (single) target tracking scheme based on networked estimation and consensus algorithms over static sensor networks. The tracking part is based on linear time-difference-of-arrival (TDOA) measurement proposed in our previous works. This paper, in particular, develops delay-tolerant distributed filtering solutions over sparse data-transmission networks. We assume general arbitrary heterogeneous delays at different links. This may occur in many realistic large-scale applications where the data-sharing between different nodes is subject to latency due to communication-reso…
This paper addresses the stabilization control problem for networked mobile robot subject to communication delay. A new state estimation filter namely past observation-based predictive filter is developed. This filter enables the prediction of system state from delayed measurement. The state estimator combined with developed control laws ensures the asymptotic stability of the networked system. Simulations with parameters extracted from a real robot system were conducted and results confirmed the correctness as well as applicability of proposed approach.
The communication channels used to convey information between the components of wireless networked control systems (WNCSs) are subject to packet losses due to time-varying fading and interference. We consider a wireless networked control scenario, where the packet loss occurs in both the sensor-controller link (sensing link) and the controller-actuator link (actuation link). Moreover, we consider one time-step delay mode observations of the actuation link. While the problems of state feedback optimal control and stabilizability conditions for systems with one time-step delay mode observations …
In this paper, we propose a design of a model-free networked controller for a nonlinear plant whose mathematical model is unknown. In a networked control system, the controller and plant are located away from each other and exchange data over a network, which causes network delays that may fluctuate randomly due to network routing. So, in this paper, we assume that the current network delay is not known but the maximum value of fluctuating network delays is known beforehand. Moreover, we also assume that the sensor cannot observe all state variables of the plant. Under these assumption, we app…
A Passivity-Based Design for Stability and Robustness in Event-Triggered Networked Control Systems with Communication Delays, Signal Quantizations and Packet Dropouts
In this paper, we propose a novel framework for modeling and analysis of networked discrete-event systems (DES). We assume that the plant is controlled by a feedback supervisor whose control decisions are subject to communication delays and losses. Furthermore, we consider a general setting where the supervisor sends control decisions to different actuators via different communication channels whose dynamics are independent. We provide a system theoretic approach by identifying the state-space of overall networked system and investigating the dynamic of the entire state-space. Our approach pre…
This paper presents a network hardware-in-the-loop (HIL) simulation system for modeling large-scale power systems. Researchers have developed many HIL test systems for power systems in recent years. Those test systems can model both microsecond-level dynamic responses of power electronic systems and millisecond-level transients of transmission and distribution grids. By integrating individual HIL test systems into a network of HIL test systems, we can create large-scale power grid digital twins with flexible structures at required modeling resolution that fits for a wide range of system operat…
An optimal control law for networked control systems with a discrete-time linear time-invariant (LTI) system as plant and networks between sensor and controller as well as between controller and actuator is proposed. This controller is designed by solving an optimization problem that is a generalization of the optimization problem used to obtain the Linear Quadratic Regulator (LQR) for deterministic discrete-time LTI systems. The networks are represented by random delays and drop outs of transmitted data packets.
This paper studies the stability and $\mathcal{H}_{\infty}$ performance analysis problem for linear networked and quantized control systems with both communication delays random packet losses. To deal with the network-induced uncertainties and random packet dropouts, a novel discrete-time stochastic system model is developed for continuous-time networked control systems, and further overapproximated via a polytopic system with norm-bounded uncertainty. Based on the overapproximated system model, sufficient conditions are established for linear networked and quantized control systems in differe…
This manuscript discusses a scalable controller synthesis method for networked systems with a large number of identical subsystems based on the H-infinity control framework. The dynamics of the individual subsystems are described by identical linear time-invariant delay differential equations and the effect of transport and communication delay is explicitly taken into account. The presented method is based on the result that, under a particular assumption on the graph describing the interconnections between the subsystems, the H-infinity norm of the overall system is upper bounded by the robus…
This paper studies the distributed L2-gain control problem for continuous-time large-scale systems under Round-Robin communication protocol. In this protocol, each sub-controller obtains its own subsystem's state information continuously, while communicating with neighbors at discrete-time instants periodically. Distributed controllers are designed such that the closed-loop system is exponentially stable and that the prescribed L2-gain is satisfied. The design condition is obtained based on a time-delay approach and given in terms of linear matrix inequalities. Finally, three numerical example…
In Networked Control Systems (NCS) impairments of the communication channel can be disruptive to stability and performance. In this paper, we consider the problem of scheduling the access to limited communication resources for a number of decoupled closed-loop systems subject to state and input constraint. The control objective is to preserve the invariance property of local state and input sets, such that constraint satisfaction can be guaranteed. Offline and online, state feedback scheduling policies are proposed and illustrated through numerical examples, also in case the network is subject…
