arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.11240cs.LG
收藏

基于图神经网络的快速实例特定算法配置

Fast instance-specific algorithm configuration with graph neural network

AI Laboratory Fujitsu Limited(富士通有限公司人工智能实验室)

Shingo Aihara, Matthieu Parizy

AI总结:

提出用图神经网络简化ISAC的特征提取与类别判定,将执行步骤的调参时间从几十秒降至亚秒级,提升组合优化求解器的实例特定配置效率。

摘要:

组合优化(CO)问题在各类工业应用中至关重要,解决这些问题的速度至关重要。为了在不同输入实例上提升CO求解器的性能,需要针对每个实例微调求解器参数。然而,这一调参过程耗时,且所需时间随实例数量增加而增加。为解决此问题,一种名为实例特定算法配置(ISAC)的方法被提出。该方法包括两个主要步骤:训练和执行。在训练步骤中,从各种实例中提取特征,然后将其分组为聚类。对每个聚类,参数被微调。这种针对聚类的调参过程产生了一组适用于每个类别中实例的广义参数。在执行步骤中,从未知实例中提取特征以确定其聚类,并应用相应的预调参数。通常,求解器的运行时间通过求解时间($TTS$)来评估。然而,像ISAC这样的方法需要预处理。因此,总执行时间为$T_{tot}=TTS+T_{tune}$,其中$T_{tune}$表示调参时间。虽然目标是使$T_{tot}$最小化,但重要的是要注意,在ISAC方法中提取特征需要一定的计算时间。提取的特征包括求解器执行日志的汇总统计,这需要几十秒。本研究提出了一种方法,通过使用图神经网络简化特征提取和类别确定,显著减少ISAC执行步骤的时间。实验结果表明,在执行步骤中,原本ISAC方式需要几十秒的$T_{tune}$可减少到亚秒级。

英文摘要:

Combinatorial optimization (CO) problems are pivotal across various industrial applications, where the speed of solving these problems is crucial. Improving the performance of CO solvers across diverse input instances requires fine-tuning solver parameters for each instance. However, this tuning process is time-consuming, and the time required increases with the number of instances. To address this, a method called instance-specific algorithm configuration (ISAC) has been devised. This approach involves two main steps: training and execution. During the training step, features are extracted from various instances and then grouped into clusters. For each cluster, parameters are fine-tuned. This cluster-specific tuning process results in a set of generalized parameters for instances belonging to each class. In the execution step, features are extracted from an unknown instance to determine its cluster, and the corresponding pre-tuned parameters are applied. Generally, the running time of a solver is evaluated by the time to solution ($TTS$). However, methods like ISAC require preprocessing. Therefore, the total execution time is $T_{tot}=TTS+T_{tune}$, where $T_{tune}$ represents the tuning time. While the goal is to minimize $T_{tot}$, it is important to note that extracting features in the ISAC method requires a certain amount of computational time. The extracting features include summary statistics of the solver execution logs, which takes several 10 seconds. This research presents a method to significantly reduce the time of the ISAC execution step by streamlining feature extraction and class determination with a graph neural network. Experimental results show that $T_{tune}$ in the execution step, which take several 10 seconds in the original ISAC manner, could be reduced to sub-seconds.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑