arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2102.09193cs.LGcs.AI
收藏

SeaPearl:一个强化学习指导下的约束规划求解器

SeaPearl: A Constraint Programming Solver guided by Reinforcement Learning

École Polytechnique, Institut Polytechnique de Paris(巴黎综合理工学院,巴黎综合理工大学);École Polytechnique de Montréal(蒙特利尔综合理工学院)

Félix Chalumeau, Ilan Coulon, Quentin Cappart, Louis-Martin Rousseau

摘要:

设计求解组合优化问题的高效通用算法是一个活跃的研究领域。标准的精确求解方法是基于对解集的巧妙而完整的枚举。使用这种方法的一个关键和重要的设计选择是分支策略,它指导如何执行搜索。在过去的十年中,人们对设计基于机器学习的算法来解决组合优化问题表现出越来越大的兴趣。目标是利用历史数据中的知识来解决问题的类似新实例。单独使用时,这种算法只能有效地提供近似解,但不能证明其解的最优性或边界。最近的工作表明,强化学习可以成功地用于驱动约束规划(CP)求解器的搜索阶段。然而,也已经表明,这种混合是具有挑战性的建设,因为标准的CP框架不包括原生的机器学习机制,导致一些低效率的来源。本文介绍了SeaPearl的概念证明,这是一种在Julia中实现的新CP求解器,它支持机器学习例程,以便使用强化学习来学习分支决策。还提供了对学习组件建模的支持。我们说明了两个问题的建模和解决方案的性能,这个新的求解器。虽然还没有与工业求解器竞争,但SeaPearl旨在提供一个灵活的开源框架,以促进未来约束编程和机器学习混合的研究。

英文摘要:

The design of efficient and generic algorithms for solving combinatorial optimization problems has been an active field of research for many years. Standard exact solving approaches are based on a clever and complete enumeration of the solution set. A critical and non-trivial design choice with such methods is the branching strategy, directing how the search is performed. The last decade has shown an increasing interest in the design of machine learning-based heuristics to solve combinatorial optimization problems. The goal is to leverage knowledge from historical data to solve similar new instances of a problem. Used alone, such heuristics are only able to provide approximate solutions efficiently, but cannot prove optimality nor bounds on their solution. Recent works have shown that reinforcement learning can be successfully used for driving the search phase of constraint programming (CP) solvers. However, it has also been shown that this hybridization is challenging to build, as standard CP frameworks do not natively include machine learning mechanisms, leading to some sources of inefficiencies. This paper presents the proof of concept for SeaPearl, a new CP solver implemented in Julia, that supports machine learning routines in order to learn branching decisions using reinforcement learning. Support for modeling the learning component is also provided. We illustrate the modeling and solution performance of this new solver on two problems. Although not yet competitive with industrial solvers, SeaPearl aims to provide a flexible and open-source framework in order to facilitate future research in the hybridization of constraint programming and machine learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑