arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.00967stat.MLcs.LG
收藏

面向互联系统的贝叶斯优化框架的实现研究

On the Implementation of a Bayesian Optimization Framework for Interconnected Systems

University of Wisconsin-Madison(威斯康星大学麦迪逊分校)

Leonardo D. González, Victor M. Zavala

AI总结:

本文针对互联系统提出并详细实现了灰箱贝叶斯优化框架BOIS,通过自适应线性化获得复合函数统计矩的解析表达式,在化学过程优化与设计案例中表现优于或持平现有方法且计算成本更低。

摘要:

贝叶斯优化(BO)是优化采样成本高昂系统的有效范式。标准BO通过使用高斯过程(GP)模型学习系统性能 $f(x)$;这种方式将系统视为黑箱,限制了其利用可用结构知识(例如复杂系统中的物理信息和稀疏互连)的能力。灰箱建模将性能函数视为已知与未知中间函数 $f(x, y(x))$ 的复合(其中 $y(x)$ 是GP模型),为这一局限提供了解决方案;然而,从 $y(x)$ 的高斯密度出发为 $f$ 生成解析概率密度通常是一个难以处理的问题(例如当 $f$ 为非线性时)。先前的工作通过使用采样技术,或在增广空间上求解辅助问题来处理该问题,其中 $y(x)$ 的值受由GP模型导出的置信区间约束;此类解决方案计算密集。在本工作中,我们详细实现了最近提出的灰箱BO范式BOIS,该范式利用 $f$ 的自适应线性化来获得复合函数统计矩的解析表达式。我们表明,BOIS方法能够利用结构知识,例如互联系统以及嵌入多个GP模型和物理与GP模型组合的系统中所产生的结构知识。我们通过两个聚焦于化学过程优化与设计的案例研究,将BOIS与标准BO及现有灰箱BO算法的有效性进行基准对比。结果表明,BOIS的表现与现有灰箱方法相当或更优,同时计算密集程度更低。

英文摘要:

Bayesian optimization (BO) is an effective paradigm for the optimization of expensive-to-sample systems. Standard BO learns the performance of a system $f(x)$ by using a Gaussian Process (GP) model; this treats the system as a black-box and limits its ability to exploit available structural knowledge (e.g., physics and sparse interconnections in a complex system). Grey-box modeling, wherein the performance function is treated as a composition of known and unknown intermediate functions $f(x, y(x))$ (where $y(x)$ is a GP model) offers a solution to this limitation; however, generating an analytical probability density for $f$ from the Gaussian density of $y(x)$ is often an intractable problem (e.g., when $f$ is nonlinear). Previous work has handled this issue by using sampling techniques or by solving an auxiliary problem over an augmented space where the values of $y(x)$ are constrained by confidence intervals derived from the GP models; such solutions are computationally intensive. In this work, we provide a detailed implementation of a recently proposed grey-box BO paradigm, BOIS, that uses adaptive linearizations of $f$ to obtain analytical expressions for the statistical moments of the composite function. We show that the BOIS approach enables the exploitation of structural knowledge, such as that arising in interconnected systems as well as systems that embed multiple GP models and combinations of physics and GP models. We benchmark the effectiveness of BOIS against standard BO and existing grey-box BO algorithms using a pair of case studies focused on chemical process optimization and design. Our results indicate that BOIS performs as well as or better than existing grey-box methods, while also being less computationally intensive.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑