Uncertain Multi-Agent Systems with Distributed Constrained Optimization Missions and Event-Triggered Communications: Application to Resource Allocation
This paper deals with solving distributed optimization problems with equality constraints by a class of uncertain nonlinear heterogeneous dynamic multi-agent systems. It is assumed that each agent with an uncertain dynamic model has limited information about the main problem and limited access to the information of the state variables of the other agents. A distributed algorithm that guarantees cooperative solving of the constrained optimization problem by the agents is proposed. Via this algorithm, the agents do not need to continuously broadcast their data. It is shown that the proposed algorithm can be useful in solving resource allocation problems.
A User-Triggered UAV Dispatching System for Precise and Timely Mountain Search Missions
School of Science and Technology, Hong Kong Metropolitan University（香港都会大学理学院）；The School of Cybersecurity, Northwestern Polytechnical University（西北工业大学网络空间安全学院）
Distributed state estimation is examined for a sensor network tasked with reconstructing a system's state through the use of a distributed and event-triggered observer. Each agent in the sensor network employs a deep neural network (DNN) to approximate the uncertain nonlinear dynamics of the system, which is trained using a multiple timescale approach. Specifically, the outer weights of each DNN are updated online using a Lyapunov-based gradient descent update law, while the inner weights and biases are trained offline using a supervised learning method and collected input-output data. The obs…
The fact that event-triggered control (ETC) often exhibits an improved performance-communication tradeoff over time-triggered control renders it especially useful for Networked Control Systems (NCSs). However, it has proven difficult to characterize the traffic produced by ETC a priori. Rollout ETC addresses this issue by using a triggering and control law that is implicitly defined by the solution to an optimal control problem (OCP), instead of an explicit one as in classical ETC. This allows to directly incorporate predefined constraints on the transmission traffic as well as on states and i…
In this paper, we study the robustness of the event-triggered consensus algorithms against frequency-domain uncertainties. It is revealed that the sampling errors resulted by event triggering are essentially images of linear finite-gain $\mathcal{L}_2$-stable operators acting on the consensus errors of the sampled states and the event-triggered mechanism is equivalent to a negative feedback loop introduced additionally to the feedback system. In virtue of this, the robust consensus problem of the event-triggered network systems subject to additive dynamic uncertainties and network multiplicati…
In this work, we derive a region-based self-triggered control (STC) scheme for nonlinear systems with bounded disturbances and model uncertainties. The proposed STC scheme is able to guarantee different performance specifications (e.g. stability, boundedness, etc.), depending on the event-triggered control (ETC) triggering function that is chosen to be emulated. To deal with disturbances and uncertainties, we employ differential inclusions (DIs). By introducing ETC/STC notions in the context of DIs, we extend well-known results on ETC/STC to perturbed uncertain systems. Given these results, an…
This paper considers the control of uncertain systems that are operated under limited resource factors, such as battery life or hardware longevity. We consider here resource-aware self-triggered control techniques that schedule system operation non-uniformly in time in order to balance performance against resource consumption. When running in an uncertain environment, unknown disturbances may deteriorate system performance by acting adversarially against the planned event triggering schedule. In this work, we propose a resource-aware stochastic predictive control scheme to tackle this challeng…
This paper investigates the distributed event-triggered control problem for a class of uncertain pure-feedback nonlinear multi-agent systems (MASs) with polluted feedback. Under the setting of event-triggered control, substantial challenges exist in both control design and stability analysis for systems in more general non-affine pure-feedback forms wherein all state variables are not directly and continuously available or even polluted due to sensor failures, and thus far very limited results are available in literature. In this work, a nominal control strategy under regular state feedback is…
Efficiently handling time-triggered and possibly nondeterministic switches for hybrid systems reachability is a challenging task. In this paper we present an approach based on conservative set-based enclosure of the dynamics that can handle systems with uncertain parameters and inputs, where the uncertainties are bound to given intervals. The method is evaluated on the plant model of an experimental electro-mechanical braking system with periodic controller. In this model, the fast-switching controller dynamics requires simulation time scales of the order of nanoseconds. Accurate set-based com…
We investigate the problem of practical output regulation, i.e., to design a controller that brings the system output in the vicinity of a desired target value while keeping the other variables bounded. We consider uncertain systems that are possibly nonlinear and the uncertainty of their linear parts is modeled element-wise through a parametric family of matrix boxes. An optimization-based design procedure is proposed that delivers a continuous-time control and estimates the maximal regulation error. We also analyze an event-triggered emulation of this controller, which can be implemented on …
This paper outlines a complete methodology for modeling an on-orbit servicing mission scenario and designing a feedback control system for the attitude dynamics that is guaranteed to robustly meet pointing requirements, despite model uncertainties as well as large inertia and flexibility changes throughout the mission scenario. A model of the uncertain plant was derived, which fully captures the dynamics and couplings between all subsystems as well as the decoupled/coupled configurations of the chaser/target system in a single linear fractional representation (LFR). In addition, a new approach…
Model-based algorithms are deeply rooted in modern control and systems theory. However, they usually come with a critical assumption - access to an accurate model of the system. In practice, models are far from perfect. Even precisely tuned estimates of unknown parameters will deteriorate over time. Therefore, it is essential to detect the change to avoid suboptimal or even dangerous behavior of a control system. We propose to combine statistical tests with dedicated parameter filters that track unknown system parameters from state data. These filters yield point estimates of the unknown param…
The wide adoption of wireless devices in the Internet of Things requires controllers that are able to operate with limited resources, such as battery life. Operating these devices robustly in an uncertain environment, while managing available resources, increases the difficultly of controller design. This paper proposes a robust self-triggered model predictive control approach to optimize a control objective while managing resource consumption. In particular, a novel zero-order-hold aperiodic discrete-time feedback control law is developed to ensure robust constraint satisfaction for continuou…
RWTH Aachen University（亚琛工业大学）；Max Planck Institute for Intelligent Systems（马克斯·普朗克智能系统研究所）；IAV GmbH Ingenieurgesellschaft Auto und Verkehr（IAV汽车与交通工程有限公司）
Robust controllers ensure stability in feedback loops designed under uncertainty but at the cost of performance. Model uncertainty in time-invariant systems can be reduced by recently proposed learning-based methods, which improve the performance of robust controllers using data. However, in practice, many systems also exhibit uncertainty in the form of changes over time, e.g., due to weight shifts or wear and tear, leading to decreased performance or instability of the learning-based controller. We propose an event-triggered learning algorithm that decides when to learn in the face of uncerta…
Washington University at St. Louis（圣路易斯华盛顿大学）；University of Pennsylvania（宾夕法尼亚大学）
This paper addresses a new semantic multi-robot planning problem in uncertain and dynamic environments. Particularly, the environment is occupied with non-cooperative, mobile, uncertain labeled targets. These targets are governed by stochastic dynamics while their current and future positions as well as their semantic labels are uncertain. Our goal is to control mobile sensing robots so that they can accomplish collaborative semantic tasks defined over the uncertain current/future positions and labels of these targets. We express these tasks using Linear Temporal Logic (LTL). We propose a samp…
Decentralized Dynamic Event-triggered Output-feedback Control of Stochastic Non-triangular Interconnected Systems with Unknown Time-varying Sensor Sensitivity
Deep Reinforcement Learning Optimization for Uncertain Nonlinear Systems via Event-Triggered Robust Adaptive Dynamic Programming
Department of Computer Science, University College London（计算机科学系，伦敦大学学院）；Department of Electrical and Electronic Engineering, University of Manchester（电子与电气工程系，曼彻斯特大学）
On Optimal Event-Triggered Distributed Control for Stochastic Multi-Agent Systems via Reinforcement Learning
The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；The Hong Kong University of Science and Technology（香港科技大学）；South China Normal University（华南师范大学）；KTH Royal Institute of Technology（皇家理工学院）
A Novel MDP Decomposition Framework for Scalable UAV Mission Planning in Complex and Uncertain Environments
Control and Instrumentation Department（控制与仪器部门）；Interdisciplinary Research Center for Intelligent Manufacturing and Robotics（智能制造与机器人交叉研究中心）；Interdisciplinary Research Center for Smart Mobility and Logistics（智能移动与物流交叉研究中心）
We study the platoon control of vehicles with third-order nonlinear dynamics under the constant spacing policy. We consider a vehicle model with parameter uncertainties and external disturbances and propose a distributed control law based on an event-triggered extended state observer (ESO). First, an event-triggered ESO is designed to estimate the unmodeled dynamics in the vehicle model. Then based on the estimate of the unmodeled dynamics, a distributed control law is designed by using a modified dynamic surface control method. The control law of each follower vehicle only uses the informatio…
Cooperative Switched Formation Control of Autonomous Vehicles: An Event-triggered Approach to Input Saturation and Time-delay Challenges
The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；The Hong Kong University of Science and Technology（香港科技大学）；KTH Royal Institute of Technology（皇家理工学院）
This paper investigates a collaborative rover-copter path planning and exploration with temporal logic specifications under uncertain environments. The objective of the rover is to complete a mission expressed by a syntactically co-safe linear temporal logic (scLTL) formula, while the objective of the copter is to actively explore the environment and reduce its uncertainties, aiming at assisting the rover and enhancing the efficiency of the mission completion. To formalize our approach, we first capture the environmental uncertainties by environmental beliefs of the atomic propositions, under …
Event-triggered control (ETC) is a major recent development in cyber-physical systems due to its capability of reducing resource utilization in networked devices. However, while most of the ETC literature reports simulations indicating massive reductions in the sampling required for control, no method so far has been capable of quantifying these results. In this work, we propose an approach through finite-state abstractions to do formal quantification of the traffic generated by ETC of linear systems, in particular aiming at computing its smallest average inter-sample time (SAIST). The method …
In recent years, a significant research effort has been devoted to the design of distributed protocols for the control of multi-agent systems, as the scale and limited communication bandwidth characteristic of such systems render centralized control impossible. Given the strict operating conditions, it is unlikely that every agent in a multi-agent system will have local information that is consistent with the true system state. Yet, the majority of works in the literature assume that agents share perfect knowledge of their environment. This paper focuses on understanding the impact that incons…
This paper studies the formation stabilization problem of asynchronous nonlinear multi-agent systems (MAS) subject to parametric uncertainties, external disturbances and bounded time-varying communication delays. A self-triggered min-max distributed model predictive control (DMPC) approach is proposed to handle these practical issues. At triggering instants, each agent solves a local min-max optimization problem based on local system states and predicted system states of neighbors, determines its next triggering instant and broadcasts its predicted state trajectory to its neighbors. As a resul…
The control systems are an essential part of every engineering system in any industrial application. The basic purpose of controls is to manage the internal operations of the system and detect any unwanted or uncertain situation. Failure in any system may be caused by various reasons and need to be restricted to save other components of the system. event-triggered control systems manage errors and failures by identifying particular events caused by failure and then mitigate the effect of that failure as much as possible. These systems have become prominent due to their smooth and autonomous wa…
Combining control engineering with nonparametric modeling techniques from machine learning allows to control systems without analytic description using data-driven models. Most existing approaches separate learning, i.e. the system identification based on a fixed dataset, and control, i.e. the execution of the model-based control law. This separation makes the performance highly sensitive to the initial selection of training data and possibly requires very large datasets. This article proposes a learning feedback linearizing control law using online closed-loop identification. The employed Gau…
This paper considers the robustness of event-triggered control of general linear systems against additive or multiplicative frequency-domain uncertainties. It is revealed that in static or dynamic event triggering mechanisms, the sampling errors are images of affine operators acting on the sampled outputs. Though not belonging to $\mathcal{RH}_\infty$, these operators are finite-gain $\mathcal{L}_2$ stable with operator-norm depending on the triggering conditions and the norm bound of the uncertainties. This characterization is further extended to the general integral quadratic constraint (IQC…
Incorporating renewable energy sources (RESs) into manufacturing systems has been an active research area in order to address many challenges originating from the unpredictable nature of RESs such as photovoltaics.In the energy-aware scheduling for manufacturing systems, the traditional off-line scheduling techniques cannot always work well due to their lack of robustness with respect to uncertainties coming from imprecise models or unexpected situations. On the other hand, on-line scheduling or rescheduling, which can improve the robustness by using the model and the latest measurements simul…
Scalable Approach to Uncertainty Quantification and Robust Design of Interconnected Dynamical Systems
United Technologies Research Center（联合技术研究中心）；AIMdyn Inc.（AIMdyn公司）；California Institute of Technology（加州理工学院）；University of California, Santa Barbara（加利福尼亚大学圣塔芭芭拉分校）
We design a controller for an agent whose mission is to reach a stationary target while avoiding a family of obstacles which are not known a-priori. The agent moves in the two dimensional plane with non-trivial double integrator dynamics and receives only local information from its surroundings. Under mild assumptions on the family of obstacles (smoothness, sufficient distance from each other, bounded curvature, etc), we prove that our control algorithm yields guaranteed obstacle avoidance and convergence to the target.
This paper studies the event-triggered distributed fusion estimation problems for a class of nonlinear networked multisensor fusion systems without noise statistical characteristics. When considering the limited resource problems of two kinds of communication channels (i.e., sensor-to-remote estimator channel and smart sensor-to-fusion center channel), an event-triggered strategy and a dimensionality reduction strategy are introduced in a unified networked framework to lighten the communication burden. Then, two kinds of compensation strategies in terms of a unified model are designed to restr…
