arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.05166cs.NE
收藏

通过基于语言模型的迁移学习加速进化探索

Accelerating evolutionary exploration through language model-based transfer learning

Maximilian Reissmann, Yuan Fang, Andrew S. H. Ooi, Richard D. Sandberg

AI总结:

本文提出将迁移学习与基因表达式编程相结合,利用自然语言处理技术从历史优化方程中提取知识以指导初始解生成,从而提升符号回归中进化算法的收敛速率。

摘要:

基因表达式编程是一种进化优化算法,具有为回归问题生成可解释且易于实现的方程的潜力。尽管从先前优化中获得的知识可能可用,但初始候选解通常在开始时随机生成,并且通常仅包含基于用户初步假设的特征或项。这种对搜索空间缺乏约束的随机初始猜测,通常会导致在寻找最优解时产生更高的计算成本。同时,迁移学习作为一种重用已训练模型部分的技术,已成功应用于神经网络。然而,在进化算法背景下,对于符号回归,尚不存在使用该技术的通用策略。在这项工作中,我们提出了一种将迁移学习与应用于符号回归的基因表达式编程相集成的方法。所构建的框架集成了自然语言处理技术,以从先前优化过程中探索的方程中辨别相关性和重复模式。这种集成促进了将已获得的知识从相似任务迁移到新任务。通过对扩展框架在来自开放数据库和计算流体力学领域的一系列单变量问题上的实证评估,我们的结果证实,通过迁移学习机制得出的初始解提高了算法向改进解收敛的收敛速率。

英文摘要:

Gene expression programming is an evolutionary optimization algorithm with the potential to generate interpretable and easily implementable equations for regression problems. Despite knowledge gained from previous optimizations being potentially available, the initial candidate solutions are typically generated randomly at the beginning and often only include features or terms based on preliminary user assumptions. This random initial guess, which lacks constraints on the search space, typically results in higher computational costs in the search for an optimal solution. Meanwhile, transfer learning, a technique to reuse parts of trained models, has been successfully applied to neural networks. However, no generalized strategy for its use exists for symbolic regression in the context of evolutionary algorithms. In this work, we propose an approach for integrating transfer learning with gene expression programming applied to symbolic regression. The constructed framework integrates Natural Language Processing techniques to discern correlations and recurring patterns from equations explored during previous optimizations. This integration facilitates the transfer of acquired knowledge from similar tasks to new ones. Through empirical evaluation of the extended framework across a range of univariate problems from an open database and from the field of computational fluid dynamics, our results affirm that initial solutions derived via a transfer learning mechanism enhance the algorithm's convergence rate towards improved solutions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑