arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.07197cs.LG
收藏

Bayes DistNet --一种用于算法参数分布预测的鲁棒神经网络

Bayes DistNet -- A Robust Neural Network for Algorithm Runtime Distribution Predictions

University of Alberta(阿尔伯塔大学)

Jake Tuero, Michael Buro

摘要:

随机算法被用于约束满足问题(CSP)和布尔可满足性(SAT)问题的许多最先进的求解器中。对于这些问题中的许多问题,没有一个单一的解决方案可以支配其他解决方案。访问这些求解器的底层运行时分发(RTD)可以更好地使用算法选择,算法组合和重新启动策略。以前的最先进的方法直接尝试预测输入实例遵循的固定参数分布。在本文中,我们扩展RTD预测模型到贝叶斯设置的第一次。这种新模型在低观测值环境中实现了鲁棒的预测性能,以及处理删失观测值。该技术还允许更丰富的表示,这是经典模型无法实现的,经典模型限制了它们的输出表示。我们的模型在数据稀缺的情况下优于以前的最先进模型,并且可以利用删失数据,例如下限时间估计,否则这种类型的数据将被丢弃。它还可以量化其预测中的不确定性,使算法投资组合模型能够就在特定实例上运行哪种算法做出更明智的决策。

英文摘要:

Randomized algorithms are used in many state-of-the-art solvers for constraint satisfaction problems (CSP) and Boolean satisfiability (SAT) problems. For many of these problems, there is no single solver which will dominate others. Having access to the underlying runtime distributions (RTD) of these solvers can allow for better use of algorithm selection, algorithm portfolios, and restart strategies. Previous state-of-the-art methods directly try to predict a fixed parametric distribution that the input instance follows. In this paper, we extend RTD prediction models into the Bayesian setting for the first time. This new model achieves robust predictive performance in the low observation setting, as well as handling censored observations. This technique also allows for richer representations which cannot be achieved by the classical models which restrict their output representations. Our model outperforms the previous state-of-the-art model in settings in which data is scarce, and can make use of censored data such as lower bound time estimates, where that type of data would otherwise be discarded. It can also quantify its uncertainty in its predictions, allowing for algorithm portfolio models to make better informed decisions about which algorithm to run on a particular instance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑