局部重要维的序列优化
Sequential Optimization in Locally Important Dimensions
摘要:
当输入空间是高维的时,优化昂贵的黑盒函数$f(\cdot)$是具有挑战性的。顺序设计框架首先用代理函数对$f(\cdot)$建模,然后优化采集函数以确定下一步要评估的输入设置。$f(\cdot)$和采集函数的优化都受益于有效的降维。全局变量选择检测并删除不影响整个输入空间中的$f(\cdot)$的输入变量。进一步的降维可能是可能的,如果我们考虑局部变量选择周围的当前最佳估计。我们开发了一个顺序设计算法,称为顺序优化局部重要维度(SOLID),它结合了全局和局部变量的选择,以优化一个连续的,可微的功能。SOLID通过将估计的最优值周围的局部区域中的代理预测与通过移除每个输入变量而做出的$p$替代预测进行比较来执行局部变量选择。采集函数的搜索空间被进一步限制为仅关注被视为局部活动的变量,从而更加强调在局部活动维度中细化代理模型。三个测试功能的仿真研究和Sarcos机器人数据集的应用表明,SOLID优于传统方法。
英文摘要:
Optimizing an expensive, black-box function $f(\cdot)$ is challenging when its input space is high-dimensional. Sequential design frameworks first model $f(\cdot)$ with a surrogate function and then optimize an acquisition function to determine input settings to evaluate next. Optimization of both $f(\cdot)$ and the acquisition function benefit from effective dimension reduction. Global variable selection detects and removes input variables that do not affect $f(\cdot)$ across the input space. Further dimension reduction may be possible if we consider local variable selection around the current optimum estimate. We develop a sequential design algorithm called Sequential Optimization in Locally Important Dimensions (SOLID) that incorporates global and local variable selection to optimize a continuous, differentiable function. SOLID performs local variable selection by comparing the surrogate's predictions in a localized region around the estimated optimum with the $p$ alternative predictions made by removing each input variable. The search space of the acquisition function is further restricted to focus only on the variables that are deemed locally active, leading to greater emphasis on refining the surrogate model in locally active dimensions. A simulation study across three test functions and an application to the Sarcos robot dataset show that SOLID outperforms conventional approaches.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。