arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1410.7291stat.ML
收藏

基于最优化和代理逼近的计算量大模型的敏感性分析

Sensitivity Analysis for Computationally Expensive Models using Optimization and Objective-oriented Surrogate Approximations

Yilun Wang, Christine A. Shoemaker

摘要:

在本文中,我们专注于开发高效的敏感性分析方法的计算昂贵的目标函数$f(x)$的情况下,它刚刚被执行的最小化。这里的“计算昂贵”意味着它的每个评估都需要大量的时间,因此我们的主要目标是使用$f(x)$的少量函数评估来进一步推断这些不同参数的灵敏度信息。相应地,我们认为优化过程是一个自适应的试验设计,并重新使用其可用的功能评估作为初始设计点,建立代理模型$s(x)$(或称为响应面)。敏感性分析在$s(x)$上进行,$s(x)$是$f(x)$的替代品。此外,我们提出了一个新的局部多变量的敏感性措施,例如,周围的最优解,高维问题。然后提出了相应的“面向目标的试验设计“,以使生成的替代$s(x)$更好地适用于精确计算所提出的特定的局部灵敏度量。此外,我们证明了更好的性能的高斯径向基函数插值的克里格在我们的情况下,这是相对较高的维数和几个试验设计点。数值实验表明,优化过程和“面向目标的试验设计“的行为远远优于经典的拉丁超立方体设计。此外,Kriging的性能不如Gaussian RBF,特别是在高维问题的情况下。

英文摘要:

In this paper, we focus on developing efficient sensitivity analysis methods for a computationally expensive objective function $f(x)$ in the case that the minimization of it has just been performed. Here "computationally expensive" means that each of its evaluation takes significant amount of time, and therefore our main goal to use a small number of function evaluations of $f(x)$ to further infer the sensitivity information of these different parameters. Correspondingly, we consider the optimization procedure as an adaptive experimental design and re-use its available function evaluations as the initial design points to establish a surrogate model $s(x)$ (or called response surface). The sensitivity analysis is performed on $s(x)$, which is an lieu of $f(x)$. Furthermore, we propose a new local multivariate sensitivity measure, for example, around the optimal solution, for high dimensional problems. Then a corresponding "objective-oriented experimental design" is proposed in order to make the generated surrogate $s(x)$ better suitable for the accurate calculation of the proposed specific local sensitivity quantities. In addition, we demonstrate the better performance of the Gaussian radial basis function interpolator over Kriging in our cases, which are of relatively high dimensionality and few experimental design points. Numerical experiments demonstrate that the optimization procedure and the "objective-oriented experimental design" behavior much better than the classical Latin Hypercube Design. In addition, the performance of Kriging is not as good as Gaussian RBF, especially in the case of high dimensional problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑