Optimal output-feedback control and separation principle for Markov jump linear systems modeling wireless networked control scenarios (extended version)
The communication channels used to convey information between the components of wireless networked control systems (WNCSs) are subject to packet losses due to time-varying fading and interference. We consider a wireless networked control scenario, where the packet loss occurs in both the sensor-controller link (sensing link) and the controller-actuator link (actuation link). Moreover, we consider one time-step delay mode observations of the actuation link. While the problems of state feedback optimal control and stabilizability conditions for systems with one time-step delay mode observations of the actuation link have been already solved, we study the optimal output feedback control problem, and we derive a separation principle for the aforementioned wireless networked control scenario. Particularly, we show that the optimal control problem (with one time-step delay in the mode observation of actuation link state) and the optimal filtering problem can be solved independently under a TCP-like communication scheme.
In Networked Control Systems (NCS) impairments of the communication channel can be disruptive to stability and performance. In this paper, we consider the problem of scheduling the access to limited communication resources for a number of decoupled closed-loop systems subject to state and input constraint. The control objective is to preserve the invariance property of local state and input sets, such that constraint satisfaction can be guaranteed. Offline and online, state feedback scheduling policies are proposed and illustrated through numerical examples, also in case the network is subject…
This paper addresses the design of a state observer for networked systems with random delays and dropouts. The model of plant and network covers the cases of multiple sensors, out-of-sequence and buffered measurements. The measurement outcomes over a finite interval model the network measurement reception scenarios, which follow a Markov distribution. We present a tractable optimization problem to precalculate off-line a finite set of gains of jump observers. The proposed procedure allows us to trade the complexity of the observer implementation for achieved performance. Several examples illus…
In factory automation, heterogeneous manufacturing processes need to be coordinated over wireless networks to achieve safety and efficiency. These wireless networks, however, are inherently unreliable due to shadow fading induced by the physical motion of the machinery. To assure both safety and efficiency, this paper proposes a state-dependent channel model that captures the interaction between the physical and communication systems. By adopting this channel model, sufficient conditions on the maximum allowable transmission interval are then derived to ensure stochastic safety for a nonlinear…
This paper considers a co-design problem for industrial networked control systems to ensure both the stability and efficiency properties of such systems. The assurance of such properties is particularly challenging due to the fact that wireless communications in industrial environments are not only subject to shadow fading but also stochastically correlated with their surrounding environments. To address such challenges, this paper first introduces a novel state-dependent Markov channel (SD-MC) model that explicitly captures the state-dependent features of industrial wireless communication sys…
A Networked Multi-Agent System for Mobile Wireless Infrastructure on Demand
Universitat Pompeu Fabra（庞培法布拉大学）；Tampere University（坦佩雷大学）；Nokia（诺基亚公司）；University of Pennsylvania（宾夕法尼亚大学）；Zoox（佐克斯公司）；University of Pittsburgh（匹兹堡大学）；Universidad de la República（共和国大学）
The mean square stabilization problem for discrete-time networked control systems (NCSs) is investigated in this article. What the difference from most previous works is that input delay and packet losses occur simultaneously in the communication channel, moreover, the data packet dropout is modeled as a time-homogeneous Markov process which will bring some difficulties in solving the problem due to the temporal correlation. The contributions in this paper can be summarized as two points. Firstly, the equivalence condition for the solvability of linear quadratic optimal problem in finite horiz…
This paper examines a co-design problem for industrial networked control systems (NCS) whereby physical systems are controlled over wireless fading channels. In particular, the considered wireless channels are also stochastically dependent on the physical states of moving machineries in an industrial working space. In this paper, the moving machineries are modeled as Markov decision processes whereas the characteristics of the correlated fading channels are modeled as a binary random process whose probability measure is a function of both the moving machineries' physical states and the channel…
Motivated by networked systems, stochastic control, optimization, and a wide variety of applications, this work is devoted to systems of switching jump diffusions. Treating such nonlinear systems, we focus on stability issues. First asymptotic stability in the large is obtained. Then the study on exponential p-stability is carried out. Connection between almost surely exponential stability and exponential p-stability is exploited. Also presented are smooth-dependence on the initial data. Using the smooth-dependence, necessary conditions for exponential p-stability are derived. Then criteria fo…
We study transmission power budget minimization of battery-powered nodes in a remote state estimation problem over multi-hop wireless networks. Communication links between nodes are subject to fading, thereby generating random dropouts. Relay nodes help to transmit measurements from distributed sensors to an estimator node. Hopping through each relay node introduces a unit delay. Motivated by the need for estimators with low computational and implementation cost, we propose a jump estimator whose modes depend on a Markovian parameter that describes measurement transmission outcomes over a fini…
Cyber-secure networked control is modeled, analyzed, and experimentally illustrated in this paper. An attack space defined by the adversary's system knowledge, disclosure, and disruption resources is introduced. Adversaries constrained by these resources are modeled for a networked control system architecture. It is shown that attack scenarios corresponding to denial-of-service, replay, zero-dynamics, and bias injection attacks can be analyzed using this framework. Furthermore, the attack policy for each scenario is described and the attack's impact is characterized using the concept of safe s…
This paper is concerned with the linear quadratic optimal control problem for networked system simultaneously with input delay and Markovian dropout. Different from the results in the literature, we consider the hold-input strategy, which is much more computationally complicated than zero-input strategy, but much better in most cases especially in the transition phase. Necessary and sufficient conditions for the solvability of optimal control problem over a finite horizon are given by the coupled difference Riccati-type equations. Moreover, the networked control system is mean-square stability…
We develop algorithms that find and track the optimal solution trajectory of time-varying convex optimization problems which consist of local and network-related objectives. The algorithms are derived from the prediction-correction methodology, which corresponds to a strategy where the time-varying problem is sampled at discrete time instances and then a sequence is generated via alternatively executing predictions on how the optimizers at the next time sample are changing and corrections on how they actually have changed. Prediction is based on how the optimality conditions evolve in time, wh…
In this paper, we study wireless networked control systems in which the sensing devices are powered by energy harvesting. We consider a scenario with multiple plants, where the sensors communicate their measurements to their respective controllers over a shared wireless channel. Due to the shared nature of the medium, sensors transmitting simultaneously can lead to packet collisions. In order to deal with this, we propose the use of random access communication policies and, to this end, we translate the control performance requirements to successful packet reception probabilities. The optimal …
In this paper we investigate the exploitation of redundancy when routing actuation data to a discrete-time LTI system connected to the controller via a wireless network affected by packet drops. We assume that actuation packets can be delivered from the controller to the actuator via multiple paths, each associated with a delay and a packet loss probability. We show that the joint design of controller gain and routing redundancy exploitation can tremendously improve the control performance. To achieve this goal we set up and solve a LQR problem for a class of systems that extends discrete-time…
