arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2412.09053cs.LGstat.ML
收藏

面向高斯微分方程的安全主动学习

Safe Active Learning for Gaussian Differential Equations

Robert Bosch GmbH(罗伯特·博世有限公司);Bosch Center for Artificial Intelligence(博世人工智能中心)

Leon Glass, Katharina Ensinger, Christoph Zimmer

AI总结:

针对高斯过程微分方程(GPODE)训练数据收集效率低、存在安全风险的问题,提出安全主动学习算法SAL GPODE,通过带安全约束的信息最大化优化迭代推荐数据点,在两个示例中优于非主动测量方法。

摘要:

高斯过程微分方程(GPODE)凭借其捕捉系统动力学行为以及表征预测不确定性的能力,近年来获得了广泛关注。已有研究阐述了超参数的训练过程,进而实现GPODE与数据的校准。然而,如何设计高效算法来收集训练GPODE模型所需的数据,仍是一个开放的研究领域。而高质量的训练数据是决定模型性能的关键。此外,数据收集会产生时间成本与经济成本,在部分领域甚至可能对被测系统存在安全风险。因此,安全且高效的数据收集算法是构建高质量GPODE模型的核心。我们提出的新型GPODE安全主动学习(SAL)算法解决了这一挑战,它设计了一种机制,能够推荐高效且无安全风险的待收集数据。SAL GPODE的工作方式是依次推荐新数据点,对其进行测量,再用新数据更新GPODE模型,通过这种方式迭代推荐后续的数据点。SAL GPODE算法的核心是一个带约束的优化问题:在底层系统安全性的约束下,最大化新数据对GPODE模型训练的信息量。我们在两个相关示例上验证了新型SAL GPODE相较于标准非主动式新数据测量方法的优越性。

英文摘要:

Gaussian Process differential equations (GPODE) have recently gained momentum due to their ability to capture dynamics behavior of systems and also represent uncertainty in predictions. Prior work has described the process of training the hyperparameters and, thereby, calibrating GPODE to data. How to design efficient algorithms to collect data for training GPODE models is still an open field of research. Nevertheless high-quality training data is key for model performance. Furthermore, data collection leads to time-cost and financial-cost and might in some areas even be safety critical to the system under test. Therefore, algorithms for safe and efficient data collection are central for building high quality GPODE models. Our novel Safe Active Learning (SAL) for GPODE algorithm addresses this challenge by suggesting a mechanism to propose efficient and non-safety-critical data to collect. SAL GPODE does so by sequentially suggesting new data, measuring it and updating the GPODE model with the new data. In this way, subsequent data points are iteratively suggested. The core of our SAL GPODE algorithm is a constrained optimization problem maximizing information of new data for GPODE model training constrained by the safety of the underlying system. We demonstrate our novel SAL GPODE's superiority compared to a standard, non-active way of measuring new data on two relevant examples.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑