arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.06381stat.MLcs.LGstat.ME
收藏

随机动力系统鲁棒辨识的自适应贝叶斯优化

Adaptive Bayesian Optimization for Robust Identification of Stochastic Dynamical Systems

National Institute of Standards and Technology(国家标准化与技术机构);Rice University(里士满大学);Department of Physics, Colorado State University(科罗拉多州立大学物理系);Electrical Engineering Department, University of Colorado(科罗拉多大学电气工程系);National Research Institute for Metals(金属研究国家研究所)

Jinwen Xu, Qin Lu, Yaakov Bar-Shalom

AI总结:

针对线性随机动力系统辨识中MLE易陷局部最优且计算复杂的问题,提出基于集成高斯过程的贝叶斯优化方法,通过卡尔曼滤波递归高效评估目标,在RMSE和统计一致性上优于MLE,甚至突破Cramer-Rao界。

摘要:

本文研究线性随机动力系统的辨识问题,其中未知量包括系统系数和噪声方差。依赖最大似然估计(MLE)的传统方法需要复杂的梯度计算且易陷入局部最优。为克服这些局限,提出了一种基于贝叶斯优化(BO)的高样本效率全局优化方法,采用集成高斯过程(EGP)替代模型,并使用预定义字典中的加权核。该集成方法实现了更丰富的函数空间,相比单核BO提升了鲁棒性。每次目标评估通过卡尔曼滤波递归高效完成。跨参数设置和采样间隔的大量实验表明,在均方根误差(RMSE)和统计一致性方面,基于EGP的BO持续优于通过稳态滤波和期望最大化(其推导为附带贡献)实现的MLE。与集成变体不同,单核BO并不总能带来此类增益,凸显了模型平均的优势。值得注意的是,基于BO的估计器实现了低于经典Cramer-Rao界的RMSE,特别是对于长期被认为难以估计的逆时间常数。这一反直觉的结果归因于BO中GP替代模型隐式诱导的数据驱动先验。

英文摘要:

This paper deals with the identification of linear stochastic dynamical systems, where the unknowns include system coefficients and noise variances. Conventional approaches that rely on the maximum likelihood estimation (MLE) require nontrivial gradient computations and are prone to local optima. To overcome these limitations, a sample-efficient global optimization method based on Bayesian optimization (BO) is proposed, using an ensemble Gaussian process (EGP) surrogate with weighted kernels from a predefined dictionary. This ensemble enables a richer function space and improves robustness over single-kernel BO. Each objective evaluation is efficiently performed via Kalman filter recursion. Extensive experiments across parameter settings and sampling intervals show that the EGP-based BO consistently outperforms MLE via steady-state filtering and expectation-maximization (whose derivation is a side contribution) in terms of RMSE and statistical consistency. Unlike the ensemble variant, single-kernel BO does not always yield such gains, underscoring the benefits of model averaging. Notably, the BO-based estimator achieves RMSE below the classical Cramer-Rao bound, particularly for the inverse time constant, long considered difficult to estimate. This counterintuitive outcome is attributed to a data-driven prior implicitly induced by the GP surrogate in BO.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑