arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2003.04774stat.MLcs.AIcs.LGmath.OC
收藏

ENTMOOT:一个基于包围树模型的优化框架

ENTMOOT: A Framework for Optimization over Ensemble Tree Models

Imperial College London(帝国理工学院);BASF SE(巴斯夫欧洲公司)

Alexander Thebelt, Jan Kronqvist, Miten Mistry, Robert M. Lee, Nathan Sudermann-Merx, Ruth Misener

摘要:

梯度提升树和其他回归树模型在广泛的现实世界,工业应用中表现良好。这些树模型(i)提供了对重要预测特征的洞察,(ii)有效地管理稀疏数据,以及(iii)具有出色的预测能力。尽管它们具有优势,但它们通常不受决策任务和黑盒优化的欢迎,这是由于它们难以优化结构和缺乏可靠的不确定性度量。ENTMOOT是我们的新框架,用于将(已经训练好的)树模型集成到更大的优化问题中。ENTMOOT的贡献包括:(i)明确引入与树模型兼容的可靠不确定性度量,(ii)解决包含这些不确定性感知树模型的更大优化问题,(iii)证明解决方案是全局最优的,即不存在更好的解决方案。特别是,我们展示了ENTMOOT方法如何允许简单地将树模型集成到决策和黑盒优化中,在那里它被证明是常用框架的强大竞争对手。

英文摘要:

Gradient boosted trees and other regression tree models perform well in a wide range of real-world, industrial applications. These tree models (i) offer insight into important prediction features, (ii) effectively manage sparse data, and (iii) have excellent prediction capabilities. Despite their advantages, they are generally unpopular for decision-making tasks and black-box optimization, which is due to their difficult-to optimize structure and the lack of a reliable uncertainty measure. ENTMOOT is our new framework for integrating (already trained) tree models into larger optimization problems. The contributions of ENTMOOT include: (i) explicitly introducing a reliable uncertainty measure that is compatible with tree models, (ii) solving the larger optimization problems that incorporate these uncertainty aware tree models, (iii) proving that the solutions are globally optimal, i.e. no better solution exists. In particular, we show how the ENTMOOT approach allows a simple integration of tree models into decision-making and black-box optimization, where it proves as a strong competitor to commonly-used frameworks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑