arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1710.08005math.OCcs.LGstat.ML
收藏

智能“预测,然后优化”

Smart "Predict, then Optimize"

Columbia University(哥伦比亚大学);University of California, Berkeley(加利福尼亚大学伯克利分校)

Adam N. Elmachtoub, Paul Grigas

摘要:

许多现实世界的分析问题涉及两个重大挑战:预测和优化。由于每个挑战的典型复杂性,标准范例是预测-然后-优化。总的来说,机器学习工具旨在最小化预测误差,而不考虑预测将如何用于下游最优化问题。相比之下,我们提出了一个新的和非常通用的框架,称为智能“预测,然后优化”(SPO),它直接利用最优化问题结构,即,它的目标和限制,设计更好的预测模型。我们的框架的一个关键组成部分是SPO损失函数,它测量由预测引起的决策错误。训练预测模型的SPO损失是计算上的挑战,因此,我们推导出,使用对偶理论,凸代理损失函数,我们称之为SPO+损失。最重要的是,我们证明了SPO+损失是统计上一致的SPO损失在温和的条件下。我们的SPO+损失函数可以处理任何多面体,凸,甚至混合整数最优化问题与线性目标。最短路径和投资组合最优化问题的数值实验表明,SPO框架可以导致显着的改善下的预测,然后优化范式,特别是当被训练的预测模型是错误的。我们发现,使用SPO+损失训练的线性模型倾向于主导随机森林算法,即使地面实况是高度非线性的。

英文摘要:

Many real-world analytics problems involve two significant challenges: prediction and optimization. Due to the typically complex nature of each challenge, the standard paradigm is predict-then-optimize. By and large, machine learning tools are intended to minimize prediction error and do not account for how the predictions will be used in the downstream optimization problem. In contrast, we propose a new and very general framework, called Smart "Predict, then Optimize" (SPO), which directly leverages the optimization problem structure, i.e., its objective and constraints, for designing better prediction models. A key component of our framework is the SPO loss function which measures the decision error induced by a prediction. Training a prediction model with respect to the SPO loss is computationally challenging, and thus we derive, using duality theory, a convex surrogate loss function which we call the SPO+ loss. Most importantly, we prove that the SPO+ loss is statistically consistent with respect to the SPO loss under mild conditions. Our SPO+ loss function can tractably handle any polyhedral, convex, or even mixed-integer optimization problem with a linear objective. Numerical experiments on shortest path and portfolio optimization problems show that the SPO framework can lead to significant improvement under the predict-then-optimize paradigm, in particular when the prediction model being trained is misspecified. We find that linear models trained using SPO+ loss tend to dominate random forest algorithms, even when the ground truth is highly nonlinear.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑