基于样本的Optimization中的偏差减小
Bias Reduction in Sample-Based Optimization
摘要:
我们考虑随机最优化问题,它使用观测数据来估计所涉及的随机量的基本特征。样本平均近似(SAA)或经验(插件)估计是在优化中使用数据的非常流行的方法。众所周知,样本平均优化受到向下偏差的影响。我们建议在最优化问题中使用光滑估计而不是经验估计。我们建立了新问题的最优值和最优解集的一致性结果。所提出的方法的性能进行了比较SAA理论和数值。我们分析了新问题的偏差,并确定了充分条件,以确保真正的问题的最优值的偏差较小的估计。同时,新估计器的误差保持受控。我们发现,这些条件是满足许多流行的统计问题,如回归模型,分类问题,和最优化问题的平均(条件)风险价值。我们已经观察到,平滑回归问题中的最小二乘目标的正常内核导致岭回归。我们的数值实验表明,新的估计往往也表现出较小的方差和较小的均方误差比SAA。
英文摘要:
We consider stochastic optimization problems which use observed data to estimate essential characteristics of the random quantities involved. Sample average approximation (SAA) or empirical (plug-in) estimation are very popular ways to use data in optimization. It is well known that sample average optimization suffers from downward bias. We propose to use smooth estimators rather than empirical ones in optimization problems. We establish consistency results for the optimal value and the set of optimal solutions of the new problem formulation. The performance of the proposed approach is compared to SAA theoretically and numerically. We analyze the bias of the new problems and identify sufficient conditions for ensuring less biased estimation of the optimal value of the true problem. At the same time, the error of the new estimator remains controlled. We show that those conditions are satisfied for many popular statistical problems such as regression models, classification problems, and optimization problems with Average (Conditional) Value-at-Risk. We have observed that smoothing the least-squares objective in a regression problem by a normal kernel leads to a ridge regression. Our numerical experience shows that the new estimators frequently exhibit also smaller variance and smaller mean-square error than those of SAA.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。