This paper proposes a framework for automatic formal controller synthesis for general hybrid systems with a subset of safety and reachability specifications. The framework uses genetic programming to automatically co-synthesize controllers and candidate Lyapunov-like functions. These candidate Lyapunov-like functions are used to formally verify the control specification, and their correctness is proven using a Satisfiability Modulo Theories solver. The advantages of this approach are: no restriction is made to polynomial systems, the synthesized controllers are expressed as compact expressions, and no explicit solution structure has to be specified beforehand. We demonstrate the effectiveness of the proposed framework in several case studies, including nonpolynomial systems, sampled-data systems, systems with bounded uncertainties, switched systems, and systems with jumps. osed framework in several case studies, including nonpolynomial systems, sampled-data systems, systems with bounded uncertainties, switched systems, and systems with jumps.
Genetic Algorithm Based Improved Sub-Optimal Model Reduction in Nyquist Plane for Optimal Tuning Rule Extraction of PID and PIλDμ Controllers via Genetic Programming
Jadavpur University（贾达普大学）；Bhabha Atomic Research Centre（巴哈原子研究中心）
In this paper, we propose a novel linear quadratic Gaussian controller whose parameters can be automatically tuned. While linear quadratic regulator method has been widely used in adaptive cruise control system design, researchers have not yet proposed a feasible and effective linear quadratic regulator. Neither did they well tackle with process and measurement noise, nor did they solve the tedious and inefficient tuning problem in adaptive cruise control system design. To compensate for the noise, the authors introduced linear quadratic Gaussian where Kalman filter is applied. And to make the…
The performance of on telescope depend strongly on its operating conditions. During pointing the telescope can move at a relatively high velocity, and the system can tolerate trajectory position errors higher than during tracking. On the contrary, during tracking Alt-Az telescopes generally move slower but still in a large dynamic range. In this case, the position errors must be as close to zero as possible. Tracking is one of the essential factors that affect the quality of astronomical observations. In this paper, a hybrid Genetic-Fuzzy approach to control the movement of a two-link direct-d…
In this paper, we propose a formal controller synthesis approach for integrating a population of plug-in electric vehicles in frequency regulation of power systems. This approach is the first application of formal methods to the smart grids in particular to the frequency regulation of power systems. We design and simulate a novel symbolic controller for the Great Britain power system. The proposed controller enhances the frequency response behaviour of the system when encountered with a large outage event. The symbolic controller guarantees the settlement of the after-event's frequency in the …
We propose a counterexample-guided inductive synthesis framework for the formal synthesis of closed-form sampled-data controllers for nonlinear systems to meet STL specifications over finite-time trajectories. Rather than stating the STL specification for a single initial condition, we consider an (infinite and bounded) set of initial conditions. Candidate solutions are proposed using genetic programming, which evolves controllers based on a finite number of simulations. Subsequently, the best candidate is verified using reachability analysis; if the candidate solution does not satisfy the spe…
For the implementations of controllers on digital processors, certain limitations, e.g. in the instruction set and register length, need to be taken into account, especially for safety-critical applications. This work aims to provide a computer-certified inductive definition for the control functions that are implemented on such processors accompanied with the fixed-point data type in a proof assistant. Using these inductive definitions we formally ensure correct realization of the controllers on a digital processor. Our results guarantee overflow-free computations of the implemented control a…
We consider the optimal distributed controller design problem subject to two structural requirements: locality, i.e. available measurements and sub-controllers' interactions are governed by a graph structure, and relative feedback, i.e. only differences of measurements are available to the controller. We formalize controller locality in terms of the controller's transfer function, state-space realization, or resulting closed-loop mapping. We demonstrate that the relative feedback requirement can be written as a convex constraint on the controller and (in special cases) on the resulting closed-…
Radboud University（拉德堡德大学）；University of Oxford（牛津大学）
Capturing uncertainty in models of complex dynamical systems is crucial to designing safe controllers. Stochastic noise causes aleatoric uncertainty, whereas imprecise knowledge of model parameters leads to epistemic uncertainty. Several approaches use formal abstractions to synthesize policies that satisfy temporal specifications related to safety and reachability. However, the underlying models exclusively capture aleatoric but not epistemic uncertainty, and thus require that model parameters are known precisely. Our contribution to overcoming this restriction is a novel abstraction-based co…
In this work, we address the problem of formal safety verification for stochastic cyber-physical systems (CPS) equipped with ReLU neural network (NN) controllers. Our goal is to find the set of initial states from where, with a predetermined confidence, the system will not reach an unsafe configuration within a specified time horizon. Specifically, we consider discrete-time LTI systems with Gaussian noise, which we abstract by a suitable graph. Then, we formulate a Satisfiability Modulo Convex (SMC) problem to estimate upper bounds on the transition probabilities between nodes in the graph. Us…
Ensuring constraint satisfaction in large-scale systems with hard constraints is vital in many safety critical systems. The challenge is to design controllers that are efficiently synthesized offline, easily implementable online, and provide formal correctness guarantees. In this paper, we provide a method to compute correct-by-construction controllers for a network of coupled linear systems with additive bounded disturbances such that i) the design of the controllers is fully compositional - we use an optimization-based approach that iteratively computes subsystem-level assume-guarantee contr…
Fractional order [PI] Controller and Smith-like Predictor Design for A Class of High Order Systems
Tsinghua University（清华大学）；Southeast University（东南大学）；University of Science and Technology of China（中国科学技术大学）；University of California, Merced（加州大学默塞德分校）
In the current control design of safety-critical autonomous systems, formal verification techniques are typically applied after the controller is designed to evaluate whether the required properties (e.g., safety) are satisfied. However, due to the increasing system complexity and the fundamental hardness of designing a controller with formal guarantees, such an open-loop process of design-then-verify often results in many iterations and fails to provide the necessary guarantees. In this paper, we propose a correct-by-construction control learning framework that integrates the verification int…
Runtime energy management has become quintessential for multi-sensor autonomous systems at the edge for achieving high performance given the platform constraints. Typical for such systems, however, is to have their controllers designed with formal guarantees on safety that precede in priority such optimizations, which in turn limits their application in real settings. In this paper, we propose a novel energy optimization framework that is aware of the autonomous system's safety state, and leverages it to regulate the application of energy optimization methods so that the system's formal safety…
In this paper, we consider the problem of formally verifying a Neural Network (NN) based autonomous landing system. In such a system, a NN controller processes images from a camera to guide the aircraft while approaching the runway. A central challenge for the safety and liveness verification of vision-based closed-loop systems is the lack of mathematical models that captures the relation between the system states (e.g., position of the aircraft) and the images processed by the vision-based NN controller. Another challenge is the limited abilities of state-of-the-art NN model checkers. Such mo…
Learning-based controllers, such as neural network (NN) controllers, can show high empirical performance but lack formal safety guarantees. To address this issue, control barrier functions (CBFs) have been applied as a safety filter to monitor and modify the outputs of learning-based controllers in order to guarantee the safety of the closed-loop system. However, such modification can be myopic with unpredictable long-term effects. In this work, we propose a safe-by-construction NN controller which employs differentiable CBF-based safety layers, and investigate the performance of safe-by-const…
To mitigate the high energy demand of Neural Network (NN) based Autonomous Driving Systems (ADSs), we consider the problem of offloading NN controllers from the ADS to nearby edge-computing infrastructure, but in such a way that formal vehicle safety properties are guaranteed. In particular, we propose the EnergyShield framework, which repurposes a controller ''shield'' as a low-power runtime safety monitor for the ADS vehicle. Specifically, the shield in EnergyShield provides not only safety interventions but also a formal, state-based quantification of the tolerable edge response time before…
Northwestern University（西北大学）；UC Berkeley（加州大学伯克利分校）；University of Liverpool（利物浦大学）；Yale University（耶鲁大学）
In model-based reinforcement learning for safety-critical control systems, it is important to formally certify system properties (e.g., safety, stability) under the learned controller. However, as existing methods typically apply formal verification \emph{after} the controller has been learned, it is sometimes difficult to obtain any certificate, even after many iterations between learning and verification. To address this challenge, we propose a framework that jointly conducts reinforcement learning and formal verification by formulating and solving a novel bilevel optimization problem, which…
Formally Verifying Deep Reinforcement Learning Controllers with Lyapunov Barrier Certificates
Stanford University（斯坦福大学）；The Hebrew University of Jerusalem（耶路撒冷希伯来大学）；IT University of Copenhagen（哥本哈根信息技术大学）；Google（谷歌公司）；GE Aerospace Research（GE航空航天研究院）
