John A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院);Google Brain Robotics(谷歌大脑机器人团队);Department of Electrical and Systems Engineering, University of Pennsylvania(宾夕法尼亚大学电气与系统工程系);Nonlinear Systems Laboratory, Massachusetts Institute of Technology(麻省理工学院非线性系统实验室)
Nicholas M. Boffi, Stephen Tu, Nikolai Matni, Jean-Jacques E. Slotine, Vikas Sindhwani
备注:
Fixes an error in the statement and proof of Theorem 5.1, Theorem 5.2, and Proposition D.1
Many existing tools in nonlinear control theory for establishing stability or safety of a dynamical system can be distilled to the construction of a certificate function that guarantees a desired property. However, algorithms for synthesizing certificate functions typically require a closed-form analytical expression of the underlying dynamics, which rules out their use on many modern robotic platforms. To circumvent this issue, we develop algorithms for learning certificate functions only from trajectory data. We establish bounds on the generalization error - the probability that a certificate will not certify a new, unseen trajectory - when learning from trajectories, and we convert such generalization error bounds into global stability guarantees. We demonstrate empirically that certificates for complex dynamics can be efficiently learned, and that the learned certificates can be used for downstream tasks such as adaptive control.
MSACL: Multi-Step Actor-Critic Learning with Lyapunov Certificates for Exponentially Stabilizing Control
School of Mathematical Sciences, Beihang University(北京航空航天大学数学科学学院);School of Automation Science and Electrical Engineering, Beihang University(北京航空航天大学自动化科学与电气工程学院);Fujian Key Laboratory of Financial Information Processing, Putian University(福建金融信息处理重点实验室)
Tight PAC-Bayesian Risk Certificates for Contrastive Learning
LTCI, Télécom Paris, Institut Polytechnique de Paris(LTCI,巴黎电信学院,巴黎高等理工学院);School of Computation Information and Technology, Technical University of Munich(计算信息与技术学院,慕尼黑技术大学)
Department of Mathematics and Computer Science(数学与计算机科学系);University of Southern Denmark(南方丹麦大学);Department of Computer Science(计算机科学系);Aalborg University(奥胡斯大学)