arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.08246cs.AIcs.LG
收藏

基于动态算法配置的启发式选择学习

Learning Heuristic Selection with Dynamic Algorithm Configuration

University of Freiburg(弗莱堡大学);Bosch Center for Artificial Intelligence(博世人工智能中心);Leibniz University Hannover(汉诺威莱布尼茨大学)

David Speck, André Biedenkapp, Frank Hutter, Robert Mattmüller, Marius Lindauer

摘要:

满意规划的一个关键挑战是在一个启发式搜索中使用多个算法。多个启发式估计的聚合(例如,通过取最大值)具有以下缺点:单个启发式的不良估计可能对整个搜索产生负面影响。由于启发式的性能因实例而异,因此可以成功应用算法选择等方法。此外,在搜索过程中在多个查询之间交替使用,可以平等地使用所有查询并提高性能。然而,所有这些方法都忽略了规划系统的内部搜索动态,这有助于为当前的扩展步骤选择最有用的策略。我们表明,动态算法配置可以用于动态启发式选择,考虑到内部搜索动态的规划系统。此外,我们证明了这种方法概括了现有的方法,它可以指数地提高性能的启发式搜索。为了学习动态启发式选择,我们提出了一种基于强化学习的方法,并以经验表明,考虑到规划系统的内部搜索动态的域明智的学习策略,可以超过现有的方法。

英文摘要:

A key challenge in satisficing planning is to use multiple heuristics within one heuristic search. An aggregation of multiple heuristic estimates, for example by taking the maximum, has the disadvantage that bad estimates of a single heuristic can negatively affect the whole search. Since the performance of a heuristic varies from instance to instance, approaches such as algorithm selection can be successfully applied. In addition, alternating between multiple heuristics during the search makes it possible to use all heuristics equally and improve performance. However, all these approaches ignore the internal search dynamics of a planning system, which can help to select the most useful heuristics for the current expansion step. We show that dynamic algorithm configuration can be used for dynamic heuristic selection which takes into account the internal search dynamics of a planning system. Furthermore, we prove that this approach generalizes over existing approaches and that it can exponentially improve the performance of the heuristic search. To learn dynamic heuristic selection, we propose an approach based on reinforcement learning and show empirically that domain-wise learned policies, which take the internal search dynamics of a planning system into account, can exceed existing approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑