The purpose of this report is to define abstractions for multi-agent systems under coupled constraints. In the proposed decentralized framework, we specify a finite or countable transition system for each agent which only takes into account the discrete positions of its neighbors. The dynamics of the considered systems consist of two components. An appropriate feedback law which guarantees that certain performance requirements (eg. connectivity) are preserved and induces the coupled constraints and additional free inputs which we exploit in order to accomplish high level tasks. In this work we provide sufficient conditions on the space and time discretization of the system which ensure that we can extract a well posed and hence meaningful finite transition system.
In this paper, we focus on mitigating the computational complexity in abstraction-based controller synthesis for interconnected control systems. To do so, we provide a compositional framework for the construction of abstractions for interconnected systems and a bottom-up controller synthesis scheme. In particular, we propose a notion of approximate composition which makes it possible to compute an abstraction of the global interconnected system from the abstractions (possibly of different types) of its components. Finally, by leveraging our notion of approximate composition, we propose a botto…
In this paper, we introduce a compositional method for the construction of finite abstractions of interconnected discrete-time switched systems. Particularly, we use a notion of so-called alternating simulation function as a relation between each switched subsystem and its finite abstraction. Based on some small-gain type conditions, we use those alternating simulation functions to construct compositionally an overall alternating simulation function as a relation between an interconnection of finite abstractions and that of switched subsystems. This overall alternating simulation function allo…
In this paper, we propose a compositional approach to construct opacity-preserving finite abstractions (a.k.a symbolic models) for networks of discrete-time nonlinear control systems. Particularly, we introduce new notions of simulation functions that characterize the distance between control systems while preserving opacity properties across them. Instead of treating large-scale systems in a monolithic manner, we develop a compositional scheme to construct the interconnected finite abstractions together with the overall opacity-preserving simulation functions. For a network of incrementally i…
This paper formulates and studies the concepts of approximate (alternating) bisimulation relations characterizing equivalence relations between interconnected systems and their abstractions. These equivalence relations guarantee that the symbolic model conserves the original model's dynamics. We develop a compositional approach for abstraction-based controller synthesis by relying on the notions of approximate composition and incremental input-to-state stability. In particular, given a large-scale system consisting of interconnected components, we provide conditions under which the concept of …
Dissipativity-Based Data-Driven Decentralized Control of Interconnected Systems
ETH Zurich（苏黎世联邦理工学院）；Max Planck Institute for Intelligent Systems（马克斯·普朗克智能系统研究所）；University of California Berkeley（加州大学伯克利分校）；University of Groningen（格罗宁根大学）
The current limitation in the synthesis of distributed $\mathscr{H}_2$ controllers for linear interconnected systems is scalability due to non-convex or unstructured synthesis conditions. In this paper we develop convex and structured conditions for the existence of a distributed $\mathscr{H}_2$ controller for discrete-time interconnected systems with an interconnection structure that corresponds to an arbitrary graph. Neutral interconnections and a storage function with a block-diagonal structure are utilized to attain coupling conditions that are of a considerably lower computational complex…
We develop a novel decentralized control method for a network of perturbed linear systems with dynamical couplings subject to Signal Temporal Logic (STL) specifications. We first transform the STL requirements into set containment problems and then we develop controllers to solve these problems. Our approach is based on treating the couplings between subsystems as disturbances, which are bounded sets that the subsystems negotiate in the form of parametric assume-guarantee contracts. The set containment requirements and parameterized contracts are added to the subsystems' constraints. We introd…
Decentralized Dynamic Event-triggered Output-feedback Control of Stochastic Non-triangular Interconnected Systems with Unknown Time-varying Sensor Sensitivity
Robust Decentralized Abstractions for Multiple Mobile Manipulators
ACCESS Linnaeus Center, School of Electrical Engineering, KTH Royal Institute of Technology（林奈 ACCESS 中心，电气工程学院，KTH 皇家理工学院）；KTH Center for Autonomous Systems（KTH 自主系统中心）
Compositional Construction of Infinite Abstractions for Networks of Stochastic Control Systems
Technical University of Munich（慕尼黑工业大学）；Newcastle University（纽卡斯尔大学）；University of Colorado Boulder（科罗拉多大学博尔德分校）；Ludwig Maximilian University of Munich（慕尼黑大学）
This paper concentrates on the study of the decentralized fuzzy control method for a class of fractional-order interconnected systems with unknown control directions. To overcome the difficulties caused by the multiple unknown control directions in fractional-order systems, a novel fractional-order Nussbaum function technique is proposed. This technique is much more general than those of existing works since it not only handles single/multiple unknown control directions but is also suitable for fractional/integer-order single/interconnected systems. Based on this technique, a new decentralized…
Decentralized Abstractions and Timed Constrained Planning of a General Class of Coupled Multi-Agent Systems
ACCESS Linnaeus Center, School of Electrical Engineering, KTH Royal Institute of Technology（瑞典皇家理工学院电气工程学院 ACCESS 林奈中心）；KTH Center for Autonomous Systems（KTH 自主系统中心）；Control Systems Lab, Department of Mechanical Engineering, National Technical University of Athens（雅典国立技术大学机械工程系控制系统实验室）
This paper proposes a new strategy for optimal grid frequency regulation (FR) in an interconnected power system where regional ac grids and an offshore wind farm are linked via a multi-terminal high voltage direct-current (MTDC) network. In the proposed strategy, decentralized H-infinity controllers are developed to coordinate the operations of ac synchronous generators and hybrid MTDC converters, thus achieving optimal power sharing of interconnected ac grids and minimizing frequency deviations in each grid. To develop the controllers, robust optimization problems are formulated and solved us…
This paper offers a finite-state abstraction of traffic coordination and congestion in a network of interconnected roads (NOIR). By applying mass conservation, we model traffic coordination as a Markov process. Model Predictive Control (MPC) is applied to control traffic congestion through the boundary of the traffic network. The optimal boundary inflow is assigned as the solution of a constrained quadratic programming problem. Additionally, the movement phases commanded by traffic signals are determined using receding horizon optimization. In simulation, we show how traffic congestion can be …
In this paper, we provide a compositional approach for constructing finite abstractions (a.k.a. finite Markov decision processes (MDPs)) of interconnected discrete-time stochastic switched systems. The proposed framework is based on a notion of stochastic simulation functions, using which one can employ an abstract system as a substitution of the original one in the controller design process with guaranteed error bounds on their output trajectories. To this end, we first provide probabilistic closeness guarantees between the interconnection of stochastic switched subsystems and that of their f…
We propose a compositional approach for constructing abstractions of general Markov decision processes using approximate probabilistic relations. The abstraction framework is based on the notion of $δ$-lifted relations, using which one can quantify the distance in probability between the interconnected gMDPs and that of their abstractions. This new approximate relation unifies compositionality results in the literature by incorporating the dependencies between state transitions explicitly and by allowing abstract models to have either finite or infinite state spaces. Accordingly, one can lever…
The goal of this paper is to obtain online abstractions for coupled multi-agent systems in a decentralized manner. A discrete model which captures the motion capabilities of each agent is derived over a bounded time-horizon, by discretizing a corresponding overapproximation of the agent's reachable states. The individual abstractions' composition provides a correct representation of the coupled continuous system over the horizon and renders the approach appropriate for control synthesis under high-level specifications which are assigned to the agents over this time window. Sufficient condition…
This paper investigates the decentralized stabilization problem for a class of interconnected systems in the presence of non-triangular structural uncertainties and time-varying parameters, where each subsystem exchanges information only with its neighbors and only intermittent (rather than continuous) states and input are to be utilized. Thus far to our best knowledge, no solution exists priori to this work, despite its high prevalence in practice. Two globally decentralized adaptive control schemes are presented based on the backstepping technique, the first one is developed in a continuous …
Cooperative Planning for Coupled Multi-Agent Systems under Timed Temporal Specifications
ACCESS Linnaeus Center, School of Electrical Engineering, KTH Royal Institute of Technology（林奈中心，电气工程学院，皇家理工学院）；KTH Center for Autonomous Systems（自主系统中心）
McGill University（麦吉尔大学）；Mila；Université de Montréal（蒙特利尔大学）；DeepMind
In this paper, we investigate learning temporal abstractions in cooperative multi-agent systems, using the options framework (Sutton et al, 1999). First, we address the planning problem for the decentralized POMDP represented by the multi-agent system, by introducing a \emph{common information approach}. We use the notion of \emph{common beliefs} and broadcasting to solve an equivalent centralized POMDP problem. Then, we propose the Distributed Option Critic (DOC) algorithm, which uses centralized option evaluation and decentralized intra-option improvement. We theoretically analyze the asympt…
With this contribution, we give a complete and comprehensive framework for modeling the dynamics of complex mechanical structures as port-Hamiltonian systems. This is motivated by research on the potential of lightweight construction using active load-bearing elements integrated into the structure. Such adaptive structures are of high complexity and very heterogeneous in nature. Port-Hamiltonian systems theory provides a promising approach for their modeling and control. Subsystem dynamics can be formulated in a domain-independent way and interconnected by means of power flows. The modular app…
