arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.15451math.NAcs.DCcs.NA
收藏

线性求解器参数的自动调优

Automated tuning for the parameters of linear solvers

Andrey Petrushov, Boris Krasnopolsky

AI总结:

本文提出一种结合进化策略与预训练神经网络筛选的混合优化算法,用于自动调优线性求解器参数,在约100次试验求解下实现显著加速,对SuiteSparse矩阵和湍流模拟系统分别提速超6倍和1.4-2倍。

摘要:

求解大型稀疏线性代数方程组的稳健迭代方法常常面临相应调优参数优化的问题。为了提高所关注问题的性能,需要进行特定的参数调优,而在实践中这可能是一项耗时且繁琐的任务。本文提出了一种用于调优数值方法参数的优化算法。该算法将进化策略与预训练的神经网络相结合,在构建新一代个体时使用神经网络来筛选个体。所提出的两种优化方法的耦合使得能够将进化策略的自适应特性与神经网络实现的先验知识相结合。使用神经网络作为初步筛选器可以显著放宽预测精度的要求,并允许将预训练网络复用于广泛的线性系统。\n 针对一组模型线性系统进行了详细的算法效率评估,包括来自SuiteSparse矩阵集合的系统和湍流流动模拟中的系统。获得的结果表明,预训练的神经网络可以被有效地复用以优化各种线性系统的参数,并且以约100次试验求解为代价可以实现计算上的显著加速。混合进化策略将来自SuiteSparse矩阵集合的黑盒矩阵的计算时间减少了6倍以上,并在模拟湍流流动时对线性系统序列实现了1.4至2倍的减少。这导致本文中进行的湍流流动模拟实现了高达1.8倍的加速。

英文摘要:

Robust iterative methods for solving large sparse systems of linear algebraic equations often suffer from the problem of optimizing the corresponding tuning parameters. To improve the performance of the problem of interest, specific parameter tuning is required, which in practice can be a time-consuming and tedious task. This paper proposes an optimization algorithm for tuning the numerical method parameters. The algorithm combines the evolution strategy with the pre-trained neural network used to filter the individuals when constructing the new generation. The proposed coupling of two optimization approaches allows to integrate the adaptivity properties of the evolution strategy with a priori knowledge realized by the neural network. The use of the neural network as a preliminary filter allows for significant weakening of the prediction accuracy requirements and reusing the pre-trained network with a wide range of linear systems. The detailed algorithm efficiency evaluation is performed for a set of model linear systems, including the ones from the SuiteSparse Matrix Collection and the systems from the turbulent flow simulations. The obtained results show that the pre-trained neural network can be effectively reused to optimize parameters for various linear systems, and a significant speedup in the calculations can be achieved at the cost of about 100 trial solves. The hybrid evolution strategy decreases the calculation time by more than 6 times for the black box matrices from the SuiteSparse Matrix Collection and by a factor of 1.4-2 for the sequence of linear systems when modeling turbulent flows. This results in a speedup of up to 1.8 times for the turbulent flow simulations performed in the paper.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑