锦标赛选择一直是我们所需要的吗?对Lexicase选择的批判性反思
Was Tournament Selection All We Ever Needed? A Critical Reflection on Lexicase Selection
AI总结:
本文通过实验对比锦标赛选择与epsilon-lexicase选择结合下采样的性能,发现下采样提升泛化且锦标赛选择更快,建议未来重点改进锦标赛选择。
摘要:
Lexicase选择的成功催生了多种扩展,包括其与下采样技术的结合,这进一步提升了性能。然而,近期研究发现,下采样同样能显著提升锦标赛选择的性能。这引发了一个问题:鉴于锦标赛选择运行时间更快,结合下采样的锦标赛选择是否是更优的选择。为解决此问题,我们开展了一系列实验,在具有不同噪声水平和问题规模的合成问题以及真实世界符号回归问题上,比较了epsilon-lexicase选择和锦标赛选择结合不同下采样技术的表现。总体而言,我们发现即使在相同代数下进行比较,下采样也能提升泛化能力和性能。这意味着即使在更少的适应度评估次数下,下采样也是有益的。此外,下采样成功减少了代码增长。我们观察到,锦标赛选择结合下采样时,种群多样性有所增加。进一步,我们发现结合下采样的锦标赛选择和epsilon-lexicase选择表现相似,而锦标赛选择显著更快。我们得出结论,未来的工作应进一步分析和改进锦标赛选择,而非仅专注于改进lexicase变体。
英文摘要:
The success of lexicase selection has led to various extensions, including its combination with down-sampling, which further increased performance. However, recent work found that down-sampling also leads to significant improvements in the performance of tournament selection. This raises the question of whether tournament selection combined with down-sampling is the better choice, given its faster running times. To address this question, we run a set of experiments comparing epsilon-lexicase and tournament selection with different down-sampling techniques on synthetic problems of varying noise levels and problem sizes as well as real-world symbolic regression problems. Overall, we find that down-sampling improves generalization and performance even when compared over the same number of generations. This means that down-sampling is beneficial even with way fewer fitness evaluations. Additionally, down-sampling successfully reduces code growth. We observe that population diversity increases for tournament selection when combined with down-sampling. Further, we find that tournament selection and epsilon-lexicase selection with down-sampling perform similar, while tournament selection is significantly faster. We conclude that tournament selection should be further analyzed and improved in future work instead of only focusing on the improvement of lexicase variants.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。