arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.05660cs.LGstat.ML
收藏

面向主动水平集估计的具有局部自适应高斯过程先验的鲁棒迁移学习

Robust Transfer Learning for Active Level Set Estimation with Locally Adaptive Gaussian Process Prior

Applied Artificial Intelligence Institute (A2I2)(应用人工智能研究所(A2I2))

Giang Ngo, Dang Nguyen, Sunil Gupta

AI总结:

针对主动水平集估计中先验知识可能误导的问题,提出带局部自适应高斯过程先验的鲁棒迁移学习方法,动态调整先验,经理论和实验验证收敛性与有效性更优。

摘要:

黑盒函数主动水平集估计的目标是通过迭代执行函数评估以收集更多函数信息,精准识别函数值高于或低于指定阈值的区域。当函数评估成本高昂、极大限制了我们获取大规模数据集的能力时,这一任务尤为重要。要以高采样效率对黑盒函数建模,一种颇具前景的方法是融入来自相关函数的先验知识。但如果先验知识不相关或具有误导性,该方法可能会拖慢估计任务的进度。本文提出了一种用于主动水平集估计的新型迁移学习方法,该方法可安全整合给定先验知识,同时持续对其进行调整,确保即便在先验知识不相关的情况下,水平集估计算法仍能保持鲁棒性能。我们对该算法进行了理论分析,结果表明,与不对先验进行任何调整的标准迁移学习方法相比,该算法具有更优的水平集收敛性。此外,跨多个数据集开展的大量实验证实,在应用于各类不同的水平集估计算法以及不同的迁移学习场景时,本文方法均具备有效性。

英文摘要:

The objective of active level set estimation for a black-box function is to precisely identify regions where the function values exceed or fall below a specified threshold by iteratively performing function evaluations to gather more information about the function. This becomes particularly important when function evaluations are costly, drastically limiting our ability to acquire large datasets. A promising way to sample-efficiently model the black-box function is by incorporating prior knowledge from a related function. However, this approach risks slowing down the estimation task if the prior knowledge is irrelevant or misleading. In this paper, we present a novel transfer learning method for active level set estimation that safely integrates a given prior knowledge while constantly adjusting it to guarantee a robust performance of a level set estimation algorithm even when the prior knowledge is irrelevant. We theoretically analyze this algorithm to show that it has a better level set convergence compared to standard transfer learning approaches that do not make any adjustment to the prior. Additionally, extensive experiments across multiple datasets confirm the effectiveness of our method when applied to various different level set estimation algorithms as well as different transfer learning scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑