arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2605.18005cs.LGstat.ML
收藏

通过成本敏感回归实现可扩展的决策聚焦学习

Scalable Decision-Focused Learning through Cost-Sensitive Regression

Delft University of Technology(代尔夫特理工大学);KU Leuven(库尔勒大学);Independent Researcher(独立研究者)

Noah Schutte, Senne Berden, Tias Guns, Krzysztof Postek, Neil Yorke-Smith

AI总结:

本文提出了一种基于成本敏感多输出回归的方法,用于解决包含多个不确定参数的组合优化问题,通过引入成本敏感的损失函数组件,提高了决策聚焦学习的效率和可扩展性。

摘要:

许多现实世界中的组合问题涉及不确定参数,这些参数可以根据上下文特征和历史数据进行预测。这些'预测后优化'或'上下文优化'问题已获得显著关注:端到端训练方法现在可以最小化下游任务成本而不是预测误差。然而,尽管这些决策聚焦学习(DFL)方法有效,但它们通常在训练过程中依赖于重复解决底层组合优化问题,这使得它们计算成本高且难以扩展。我们重新将学习问题视为一个成本敏感的多输出回归问题:多输出是因为组合问题有多个不确定参数,而成本敏感是因为下游任务成本是真正的目标。我们的技术贡献是正式化了多个损失函数组件,这些组件来自于这种重新框架:成本不敏感的归一化、决策意识的不对称惩罚过预测和欠预测,以及实例化的成本,这些成本在本地模仿真正的下游任务损失。这些组件需要每个训练数据实例零或一次求解,而训练过程中不需要进一步求解。实验表明,损失组件的组合在下游任务质量上与最先进的方法相当,同时显著更高效,使能够扩展到以前无法用DFL解决的问题规模。

英文摘要:

Many real-world combinatorial problems involve uncertain parameters, which can be predicted given contextual features and historical data. These `predict-then-optimize' or `contextual optimization' problems have gained significant attention: end-to-end training methods can now minimize the downstream task cost rather than the predictive error. However, despite their effectiveness, these decision-focused learning (DFL) approaches often rely on repeated solving of the underlying combinatorial optimization problem during training, making them computationally expensive and difficult to scale. We reframe the learning problem as a cost-sensitive multi-output regression problem: multi-output due to the combinatorial problem having multiple uncertain parameters, and cost-sensitive due to the downstream task cost being the real target. Our technical contribution is the formalization of multiple loss function components that follow from this reframing: cost-insensitive normalization, decision-aware asymmetric penalization of over- and underpredictions, and instance-based costs that mimic the true downstream task-based loss locally. These components require zero or one solve per training data instance, while requiring no further solves during training. Experiments show that the combination of loss components achieves comparable downstream task quality to the state of the art, while being significantly more efficient, enabling scaling to problem sizes that have not been tackled before with DFL.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑