We propose an iterative method to safely learn the unmodeled dynamics of a nonlinear system using Bayesian Gaussian process (GP) models with polynomial kernel functions. The method maintains safety by ensuring that the system state stays within the region of attraction (ROA) of a stabilizing control policy while collecting data. A quadratic programming based exploration control policy is computed to keep the exploration trajectory inside an inner-approximation of the ROA and to maximize the information gained from the trajectory. A prior GP model, which incorporates prior information about the unknown dynamics, is used to construct an initial stabilizing policy. As the GP model is updated with data, it is used to synthesize a new policy and a larger ROA, which increases the range of safe exploration. The use of polynomial kernels allows us to compute ROA inner-approximations and stabilizing control laws for the model using sum-of-squares programming. We also provide a probabilistic guarantee of safety which ensures that the policy computed using the learned model stabilizes the true dynamics with high confidence.
Model-Assisted Probabilistic Safe Adaptive Control With Meta-Bayesian Learning
University of Electronic Science and Technology of China(电子科技大学);University of Exeter(埃克塞特大学);Texas A & M University at Qatar(德州农工大学卡塔尔分校);University of Technology Sydney(悉尼科技大学);Hamad Bin Khalifa University(哈马德·本·哈利法大学)
Barrier Bayesian Linear Regression: Online Learning of Control Barrier Conditions for Safety-Critical Control of Uncertain Systems
University of Toronto Institute for Aerospace Studies(多伦多大学航空航天研究所);Technical University of Munich(慕尼黑工业大学);University of Toronto Robotics Institute(多伦多大学机器人研究所);Vector Institute for Artificial Intelligence(矢量人工智能研究所)
Bayesian Optimization with Safety Constraints: Safe and Automatic Parameter Tuning in Robotics
1 Learning \& Adaptive Systems Group, Department of Computer Science, ETH Zurich, Switzerland. 2 Dynamic Systems Lab, Institute for Aerospace Studies, University of Toronto, Canada.
Optimal Parameter Adaptation for Safety-Critical Control via Safe Barrier Bayesian Optimization
University of Electronic Science and Technology of China(电子科技大学);University of Exeter(埃克塞特大学);Australian AI Institute(澳大利亚人工智能研究所);University of Technology Sydney(悉尼科技大学);Hunan University(湖南大学);China University of Mining and Technology(中国矿业大学);Southeast University(东南大学)
PACSBO: Probably approximately correct safe Bayesian optimization
Cyber-Physical Systems Group, Aalto University, Espoo, Finland(阿alto大学智能物理系统组);Department of Information Technology, Uppsala University, Uppsala, Sweden(乌普萨拉大学信息科技系)
Bayesian Learning-Based Adaptive Control for Safety Critical Systems
Georgia Institute of Technology(佐治亚理工学院);NASA Jet Propulsion Laboratory, California Institute of Technology(美国国家航空航天局喷气推进实验室,加州理工学院);West Virginia University(西弗吉尼亚大学)