arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.05340stat.MLcs.LG
收藏

决策导向的顺序实验设计:一种方向性不确定性引导方法

Decision-Focused Sequential Experimental Design: A Directional Uncertainty-Guided Approach

Department of Statistics and Operations Research, University of North Carolina(统计与运筹学系,北卡罗来纳大学);Department of Industrial Engineering and Operations Research, University of California, Berkeley(工业工程与运筹学系,加州大学伯克利分校)

Beichen Wan, Mo Liu, Paul Grigas, Zuo-Jun Max Shen

AI总结:

本文提出一种基于方向性的不确定性度量,用于改进顺序实验设计,以更有效地优化决策损失。

摘要:

我们考虑了在预测后优化范式中的顺序实验设计问题。在该范式中,预测模型的输出被用作下游线性优化问题中的系数向量。传统的顺序实验设计旨在控制输入变量(特征),以使每个实验结果(标签)带来的预测精度提升最大化。然而,在预测后优化设置中,性能最终是根据下游优化引起的决策损失来评估的,而不是预测误差。预测精度与决策损失之间的不匹配使传统的决策盲设计效率低下。为了解决这个问题,我们提出了一种基于方向的度量来量化预测不确定性。这种度量不需要求解一个优化 oracle,因此计算上是可行的。我们证明了所得到的顺序设计准则具有强一致性和收敛保证。在广泛的分布类别下,我们证明我们的方向性不确定性设计比决策盲设计达到更早的停止时间。这一优势进一步通过现实世界实验在LLM工作分配问题上得到支持。

英文摘要:

We consider the sequential experimental design problem in the predict-then-optimize paradigm. In this paradigm, the outputs of the prediction model are used as coefficient vectors in a downstream linear optimization problem. Traditional sequential experimental design aims to control the input variables (features) so that the improvement in prediction accuracy from each experimental outcome (label) is maximized. However, in the predict-then-optimize setting, performance is ultimately evaluated based on the decision loss induced by the downstream optimization, rather than by prediction error. This mismatch between prediction accuracy and decision loss renders traditional decision-blind designs inefficient. To address this issue, we propose a directional-based metric to quantify predictive uncertainty. This metric does not require solving an optimization oracle and is therefore computationally tractable. We show that the resulting sequential design criterion enjoys strong consistency and convergence guarantees. Under a broad class of distributions, we demonstrate that our directional uncertainty-based design attains an earlier stopping time than decision-blind designs. This advantage is further supported by real-world experiments on an LLM job allocation problem.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑