新奇搜索使进化成为必然
Novelty Search makes Evolvability Inevitable
摘要：
进化性是一个重要的特征，它影响进化过程找到有趣的新解决方案和处理待解决问题的变化条件的能力。进化性的估计并不简单，而且通常太昂贵，不能直接用作进化过程中的选择压力。因此，间接地促进可进化性作为其他更容易和更快地计算选择压力的副作用将是有利的。在一个无限的行为空间中，已经证明，可进化的个体自然会出现，并且倾向于被选择，因为他们更有可能侵入空的行为生态位。因此，在这种情况下，进化性是搜索的自然副产品。然而，实际的代理和环境往往会对可达的行为空间施加限制。这些边界如何影响可进化性？在这种情况下，在没有明确奖励的情况下，进化性还能得到促进吗？我们发现，新奇搜索隐式地创建了一个压力，即使在有界的行为空间的高演化性，并探讨了这种行为的原因。更确切地说，我们表明，在整个搜索过程中，新颖性的动态评价奖励在行为空间中非常移动的个体，这反过来又促进了进化。
英文摘要：
Evolvability is an important feature that impacts the ability of evolutionary processes to find interesting novel solutions and to deal with changing conditions of the problem to solve. The estimation of evolvability is not straightforward and is generally too expensive to be directly used as selective pressure in the evolutionary process. Indirectly promoting evolvability as a side effect of other easier and faster to compute selection pressures would thus be advantageous. In an unbounded behavior space, it has already been shown that evolvable individuals naturally appear and tend to be selected as they are more likely to invade empty behavior niches. Evolvability is thus a natural byproduct of the search in this context. However, practical agents and environments often impose limits on the reach-able behavior space. How do these boundaries impact evolvability? In this context, can evolvability still be promoted without explicitly rewarding it? We show that Novelty Search implicitly creates a pressure for high evolvability even in bounded behavior spaces, and explore the reasons for such a behavior. More precisely we show that, throughout the search, the dynamic evaluation of novelty rewards individuals which are very mobile in the behavior space, which in turn promotes evolvability.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
