This paper addresses the problem of Neural Network (NN) based adaptive stability certification in a dynamical system. The state-of-the-art methods, such as Neural Lyapunov Functions (NLFs), use NN-based formulations to assess the stability of a non-linear dynamical system and compute a Region of Attraction (ROA) in the state space. However, under parametric uncertainty, if the values of system parameters vary over time, the NLF methods fail to adapt to such changes and may lead to conservative stability assessment performance. We circumvent this issue by integrating Model Agnostic Meta-learning (MAML) with NLFs and propose meta-NLFs. In this process, we train a meta-function that adapts to any parametric shifts and updates into an NLF for the system with new test-time parameter values. We demonstrate the stability assessment performance of meta-NLFs on some standard benchmark autonomous dynamical systems.
MAKO: Meta-Adaptive Koopman Operators for Learning-based Model Predictive Control of Parametrically Uncertain Nonlinear Systems
Water Research Institute (NEWRI), Nanyang Technological University, Singapore(新跃大学水研究 institute(NEWRI));School of Chemistry, Chemical Engineering and Biotechnology, Nanyang Technological University, Singapore(新跃大学化学、化工与生物技术学院);Soft Robotics Lab, ETH Zurich, Switzerland(苏黎世联邦理工学院软机器人实验室);Department of Civil and Environmental Engineering, National University of Singapore, Singapore(新加坡国立大学土木与环境工程系)
Stanford University(斯坦福大学);University of Science and Technology(科学技术大学);Tencent AI Lab(腾讯AI实验室);Pennsylvania State University(宾夕法尼亚州立大学);City University of Hong Kong(香港城市大学)
John A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院);Google Brain Robotics(谷歌大脑机器人团队);Department of Electrical and Systems Engineering, University of Pennsylvania(宾夕法尼亚大学电气与系统工程系);Nonlinear Systems Laboratory, Massachusetts Institute of Technology(麻省理工学院非线性系统实验室)
Salesforce Research Asia(Salesforce亚洲研究院);Singapore Management University(新加坡管理大学);South China University of Technology(华南理工大学);Carnegie Mellon University(卡内基梅隆大学)
VariBAD: A Very Good Method for Bayes-Adaptive Deep RL via Meta-Learning
University of Oxford(牛津大学);Latent Logic(潜在逻辑公司);Microsoft Research(微软研究院)
在未知环境中权衡探索和利用是在学习过程中最大化预期回报的关键。一个贝叶斯最优的政策,这样做最优,其行动的条件不仅对环境的状态,但代理的不确定性的环境。然而,除了最小的任务之外,计算贝叶斯最优策略对于所有任务都是棘手的。在本文中,我们介绍了变分贝叶斯-自适应深度RL(variable Bayes-Adaptive Deep RL,variBAD),这是一种在未知环境中进行近似推理的元学习方法,并在动作选择过程中直接引入任务不确定性。在网格世界域中,我们说明了variBAD如何执行结构化的在线探索任务的不确定性的函数。我们进一步评估了广泛用于元RL的MuJoCo域上的variBAD,并表明它比现有方法实现了更高的在线回报。
Adaptive Multi-Scale Correlation Meta-Network for Few-Shot Remote Sensing Image Classification
School of Computer Science, UPES, Dehradun, 248007, Uttarakhand, India.(UPES计算机科学学院);School of Computer Science and Engineering, Galgotias University, India.(加尔各答大学计算机科学与工程学院);Computer Science and Information Systems, BITS Pilani, Pilani Rajasthan, India.(比什努学院计算机科学与信息系统)
Fast Meta-Learning for Adaptive Hierarchical Classifier Design
Econometric Institute, Erasmus University Rotterdam(鹿特丹伊拉斯姆斯大学计量经济研究所);Electrical Engineering and Computer Science, University of Michigan(密歇根大学电气工程与计算机科学学院)
Safe Reach Set Computation via Neural Barrier Certificates
University of Oxford(牛津大学);Newcastle University(纽卡斯尔大学);Max Planck Institute for Software Systems(马克斯·普朗克软件系统研究所);Università di Roma “La Sapienza”(罗马第一大学)
Barrier-Certified Adaptive Reinforcement Learning with Applications to Brushbot Navigation
School of Electrical Engineering, Royal Institute of Technology(皇家理工学院电气工程学院);Georgia Institute of Technology(佐治亚理工学院);RIKEN Center for Advanced Intelligence Project(日本理化学研究所高级智能研究中心);School of Mechanical Engineering(机械工程学院)
Adaptive MPPI with Online Disturbance Covariance Estimation: Provable Stability Tightening via Spatial Smoothing
Department of Mechanical and Nuclear Engineering, Tennessee Technological University(机械与核工程系,田纳西技术大学);School of Engineering, Department of Electrical and Computer Engineering, Mercer University(工程学院,电气与计算机工程系,梅尔基大学)